-- Logs begin at Mon 2022-06-06 20:13:14 UTC, end at Mon 2022-06-06 21:22:57 UTC. -- Jun 06 20:55:27.110354 dv-cinder-844880-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 06 20:55:27.118473 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 06 20:55:27.121347 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 6 20:55:27 2022] *** Jun 06 20:55:27.121347 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 06 20:55:27.121347 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 06 20:55:27.121347 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: nodename: dv-cinder-844880-1-iscsi Jun 06 20:55:27.121347 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: machine: x86_64 Jun 06 20:55:27.121347 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: clock source: unix Jun 06 20:55:27.121347 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: pcre jit disabled Jun 06 20:55:27.121347 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: detected number of CPU cores: 4 Jun 06 20:55:27.121347 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: current working directory: / Jun 06 20:55:27.121347 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: detected binary path: /usr/bin/uwsgi-core Jun 06 20:55:27.121347 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: your processes number limit is 47680 Jun 06 20:55:27.121347 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: your memory page size is 4096 bytes Jun 06 20:55:27.121347 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: detected max file descriptor number: 2048 Jun 06 20:55:27.121347 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: lock engine: pthread robust mutexes Jun 06 20:55:27.121347 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: thunder lock: enabled Jun 06 20:55:27.121347 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 06 20:55:27.122360 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 06 20:55:27.164573 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: Python main interpreter initialized at 0x55dc3a72d9c0 Jun 06 20:55:27.164573 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: python threads support enabled Jun 06 20:55:27.164573 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: your server socket listen backlog is limited to 100 connections Jun 06 20:55:27.164573 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: your mercy for graceful operations on workers is 90 seconds Jun 06 20:55:27.165051 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: mapped 403077 bytes (393 KB) for 2 cores Jun 06 20:55:27.165051 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: *** Operational MODE: preforking *** Jun 06 20:55:27.165400 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: *** uWSGI is running in multiple interpreter mode *** Jun 06 20:55:27.165400 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: spawned uWSGI master process (pid: 103448) Jun 06 20:55:27.165618 dv-cinder-844880-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 06 20:55:27.166412 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: spawned uWSGI worker 1 (pid: 103449, cores: 1) Jun 06 20:55:27.166577 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: spawned uWSGI worker 2 (pid: 103450, cores: 1) Jun 06 20:55:27.166664 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 06 20:55:28.407574 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 20:55:28.430765 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 20:55:29.126722 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 20:55:29.126722 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: from cryptography.utils import int_from_bytes Jun 06 20:55:29.127013 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 20:55:29.127013 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: from cryptography.utils import int_from_bytes Jun 06 20:55:29.140566 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 20:55:29.140566 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: from cryptography.utils import int_from_bytes Jun 06 20:55:29.140947 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 20:55:29.140947 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: from cryptography.utils import int_from_bytes Jun 06 20:55:31.759547 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 20:55:31.760405 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 20:55:31.760553 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 20:55:31.761172 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 20:55:31.761337 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 20:55:31.761495 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 20:55:31.761495 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 20:55:31.761765 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 20:55:31.761899 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.762193 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 20:55:31.762193 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 20:55:31.762463 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.762463 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.762711 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.762836 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.762978 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.763116 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.763236 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.763359 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.763485 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.763625 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.763809 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.763934 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.764105 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.764228 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.764361 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.764488 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.764609 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.764742 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.764872 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.764872 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.765110 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844880-1-iscsi {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.765241 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.765363 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.765481 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844880-1-iscsi {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.765600 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.765731 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.765836 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.766015 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.766202 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.766376 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.766506 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.766665 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.766788 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.766918 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.767062 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.767323 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.767475 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.767718 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.767876 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.768176 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.768492 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.768800 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.769097 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.769253 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.769393 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.769595 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.769736 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.770017 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.770179 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.770316 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.770576 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.770796 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.771031 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.771250 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.771458 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844880-1-iscsi {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.771598 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.771816 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.772085 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.772288 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.772524 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.772734 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.772872 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.773017 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.773173 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.773314 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.773539 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.773697 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.773913 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.774151 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844880-1-iscsi {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.774445 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.774682 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.774908 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.775164 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.775332 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.775475 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.775708 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.775867 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.776204 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.776359 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.776519 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.776782 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.776948 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.777105 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.777249 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.777425 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.777670 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.777829 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.777970 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.778126 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.778266 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.778534 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.778822 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.779105 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.779249 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.779399 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.779552 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.779692 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.779836 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.779968 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.780414 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.780546 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.780675 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.780819 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.780950 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.781336 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.781627 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.781879 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.782119 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.782387 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.782387 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.782899 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.783129 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.783129 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.783757 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.783982 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.783982 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.784465 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.784687 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.784687 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.785274 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.785497 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.785766 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.786016 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.786016 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.786493 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.786717 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.786717 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.787213 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.787445 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.787678 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.787946 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.787946 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.788476 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.788718 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.788718 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.789164 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.789389 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.789621 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.789984 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.789984 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.790428 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.790662 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.790662 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.791093 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.791347 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.791347 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.791776 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.792045 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.792045 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.792469 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.792707 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.792924 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.793154 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.793154 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.793571 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.794072 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.794072 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.794524 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.794746 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.794746 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.795186 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.795542 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.795542 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.796119 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.796355 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.796355 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.796788 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.797008 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.797248 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.797482 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.797482 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.797899 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.798122 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.798122 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.798571 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.798813 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.798813 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.799244 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.799473 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.799473 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.799920 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.800198 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.800198 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.800640 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.800864 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.800864 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.801292 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.801525 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.801743 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.801965 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.801965 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.801965 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.802599 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.802827 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.803083 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.803303 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.803303 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.803732 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.803974 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.803974 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.804641 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.804859 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.804859 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.805304 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.805575 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.805575 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.806122 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.806356 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.806356 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.806785 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.807014 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.807238 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.807471 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.807471 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.807907 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.808152 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.808152 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.808567 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.808785 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.808785 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.809231 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.809453 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.809671 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.809889 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.809889 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.810323 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.810566 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.810566 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.810989 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.811209 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.811445 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.811679 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.811679 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.812173 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.812404 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.812623 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.812841 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.812841 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.813264 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.813486 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.813486 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.813903 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.814117 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.814117 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.814810 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.815047 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.815265 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.815487 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.815487 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.815935 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.816359 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.816359 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.816784 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.817002 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.817002 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.817437 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.817672 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.817904 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.818151 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.818151 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.818579 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.818798 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.818798 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.819225 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.819443 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.819443 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.819870 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.820124 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.820345 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.820590 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.820590 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.821018 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.821256 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.821256 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.821862 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.822223 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.822223 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.822650 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.822867 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.823088 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.823321 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.823321 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.823874 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.824139 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.824139 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.824839 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.825064 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.825064 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.825490 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.825721 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.825721 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.826150 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.826496 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.826728 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.826948 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.826948 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.827411 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.827625 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.827625 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.828100 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.828377 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.828377 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.828844 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.829081 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.829081 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.829533 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.829749 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.830008 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.830254 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.830254 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.830683 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.830902 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.830902 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.831354 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.831584 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.831584 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.832019 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.832259 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.832259 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.832689 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.832909 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.833127 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.833362 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.833362 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.833804 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.834037 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.834037 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.834456 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.834710 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.834710 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.835353 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.835573 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.835793 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.836100 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.836100 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.836742 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.837107 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.837107 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.837587 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.837806 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.837806 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.838218 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.838790 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.838790 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.839233 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.839451 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.839671 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.839901 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.839901 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.840379 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.840600 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.840600 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.841031 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.841262 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.841262 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.841687 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.841904 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.842122 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.842341 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.842341 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.842805 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 20:55:31.843024 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.843024 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.843440 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.843656 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.843656 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.844121 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.844342 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.844342 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.844769 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.845025 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.845025 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.845674 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.845915 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.845915 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.846331 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.846565 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.846565 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.847104 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.847325 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.847325 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.847733 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.847974 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.847974 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.848417 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.848654 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.848871 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.849092 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.849092 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.849528 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.849746 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.849746 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.850167 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.850407 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.850407 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.850823 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.851058 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.851289 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.851533 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.851533 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.851961 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.853261 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.853261 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.853844 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.854067 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.854067 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.854507 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.854728 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.854728 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.855154 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.855616 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.855616 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.856221 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.856462 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.856684 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.856932 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.856932 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.857367 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.857591 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.857591 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.858020 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.858240 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.858240 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.858674 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.858909 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.858909 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.859325 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.859557 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.859788 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.860030 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.860030 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.860451 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.860705 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.860705 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.861139 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.861360 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.861360 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.861790 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.862007 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.862007 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.862433 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.862652 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.862652 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.863067 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.863285 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.863285 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.863720 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.863939 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.864242 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.864481 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.864481 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.864916 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.865146 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.865146 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.865804 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.866026 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.866026 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.866471 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.866806 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.866806 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.867302 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.867519 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.867519 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.868069 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.868420 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.868696 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.868918 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.868918 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.869353 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.869575 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.869791 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.870015 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.870015 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.870432 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.870666 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.870666 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.871102 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.871335 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.871335 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.871761 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.872136 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.872365 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.872592 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.872592 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.873020 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.873242 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.873242 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.873725 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.873974 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.873974 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.874438 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.874669 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.874669 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.875121 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.875362 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.875607 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.876108 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.876108 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.876586 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.876819 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.876819 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.877271 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.877516 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.877516 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.877984 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.878214 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.878214 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.878669 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.878898 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.879141 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.879369 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.879369 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.879819 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.880098 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.880098 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.880583 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.880815 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.880815 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.881274 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.881508 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.881508 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.881973 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.882202 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.882202 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.882644 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.882891 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.883154 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.883387 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.883646 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.883881 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.883881 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.884407 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.884660 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.884660 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.885099 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.885329 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.885329 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.885786 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.886274 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.886534 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.886780 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.886780 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.887245 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.887499 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.887730 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.888015 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.888015 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.888464 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.888692 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.888692 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.889156 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.889405 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.889405 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.889843 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.890078 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.890078 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.890545 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.890786 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.891027 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.891275 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.891275 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.891743 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.892076 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.892076 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.892539 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.892772 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.892772 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.893213 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.893462 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.893462 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.893913 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.894146 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.894377 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.894621 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.894621 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.895057 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.895285 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.895285 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.895737 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.895981 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.895981 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.896702 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.896945 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.896945 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.897401 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.897646 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.897646 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.898095 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.898337 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.898584 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.898815 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.898815 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.899327 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.899562 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.899562 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.900046 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.900310 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.900310 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.900761 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.900998 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.900998 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.901438 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.901710 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.901710 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.902147 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.902387 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.902387 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.902830 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.903074 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.903305 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.903565 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.903565 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.904233 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.904477 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.904477 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.904960 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.905206 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.905206 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.905640 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.905885 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.905885 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.906351 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.906763 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.906999 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.907230 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.907230 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.907686 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.907920 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.908219 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.908454 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.908454 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.908921 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.909164 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.909164 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.909614 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.909844 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.909844 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.910295 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.910538 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.910776 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.911005 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.911005 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.911475 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.911715 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.911715 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.912201 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.912435 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.912435 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.912997 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.913236 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.913236 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.913682 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.913953 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.913953 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.914533 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.914796 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.914796 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.915251 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.915481 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.915481 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.915930 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.916141 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.916141 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.916324 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.916393 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.916393 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.916525 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.916599 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.916666 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.916731 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.916731 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.916864 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.916939 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.916939 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.917065 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.917137 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.917137 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.917265 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.917332 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.917332 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.917447 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.917511 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.917575 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.917648 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.917648 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.917765 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.917848 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.917848 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.917980 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.918055 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.918055 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.918180 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.918246 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.918246 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.918392 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.918462 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.918462 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.918579 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.918643 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.918706 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.918783 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.918783 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.918910 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.918975 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.918975 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.919090 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.919163 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.919163 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.919291 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.919356 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.919356 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.919470 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.919543 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.919609 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.919674 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.919674 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.919789 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.919861 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.919861 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.920009 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.920081 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.920081 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.920199 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.920278 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.920278 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.920423 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.920504 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.920504 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.920623 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.920697 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.920697 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.920824 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.920888 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.920888 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.921004 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.921080 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.921163 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.921233 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.921233 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.921349 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.921422 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.921422 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.921549 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.921622 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.921622 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.921740 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.921816 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.921882 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.921946 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.921946 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.922060 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.922124 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.922124 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.922249 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.922313 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.922389 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.922455 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.922455 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.922583 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.922650 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.922650 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.922765 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.922829 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.922829 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.922959 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.923032 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.923032 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.923158 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.923231 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.923231 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.923369 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.923437 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.923501 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.923566 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.923566 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.923690 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.923756 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.923756 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.923871 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.923935 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.924354 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.924463 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.924463 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.924588 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.924654 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.924718 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.924795 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.924795 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.924914 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.924987 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.924987 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.925104 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.925177 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.925177 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.925304 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.925378 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.925444 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.925515 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.925515 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.925653 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.925728 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.925728 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.925844 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.925908 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.925908 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.926045 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.926111 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.926111 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.926236 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.926315 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.926381 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.926446 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.926446 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.926561 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.926625 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.926625 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.926750 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.926815 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.926815 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.926937 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.927015 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.927094 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.927160 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.927160 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.927283 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.927349 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.927349 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.927471 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.927537 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.927537 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.927651 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.927715 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.927715 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.927917 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.928009 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.928009 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.928149 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.928218 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.928218 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.928355 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.928422 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.928487 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.928558 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.928558 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.928684 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.928758 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.928758 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.928883 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.928950 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.928950 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.929078 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.929158 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.929158 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.929280 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.929474 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.929812 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.929931 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.930121 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.930379 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.930617 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.930831 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.930978 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.931166 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.931430 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.931668 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.931813 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.932032 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.932315 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.932450 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.932675 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.932806 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.932980 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.933189 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.933295 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.933607 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.933711 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.933921 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.934020 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.934234 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.934532 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.934646 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.934840 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.934994 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.935147 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.935433 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.935525 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.935756 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.935853 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.936145 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.936311 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.936457 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.936745 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.936838 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.937079 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.937163 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.937406 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.937591 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.937720 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.938021 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.938108 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.938329 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.938478 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.938637 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.938982 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.939224 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.939311 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.939618 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.939716 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.939948 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.940128 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.940300 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.940587 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.940673 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.940941 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.941027 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.941268 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.941474 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.941592 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.941910 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.942004 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.942230 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.942382 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.942549 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.942860 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.942966 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.943175 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.943292 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.943491 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.943746 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.943833 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.944139 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.944243 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.944458 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.944627 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.944827 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.945135 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.945331 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.945566 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.945654 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.945964 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.946085 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.946324 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.946433 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.946742 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.946841 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.947062 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.947246 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.947377 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.947673 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.947769 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.948009 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.948153 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.948333 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.948592 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.948688 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.948965 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.949050 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.949292 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.949450 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.949621 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.949902 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.949989 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.950268 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.950398 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.950587 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.950792 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.950911 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.951228 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.951314 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.951585 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.951673 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.951902 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.952110 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.952254 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.952537 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.952623 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.952874 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.953013 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.953190 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.953442 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.953528 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.953804 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.953897 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.954121 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.954342 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.954436 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.954738 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.954967 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.955069 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.955355 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.955442 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.955670 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.955787 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.956064 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.956294 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.956390 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.956665 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.956751 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.956984 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.957148 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.957329 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.957585 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.957680 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.958006 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.958143 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.958444 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.958532 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.958798 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.958936 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.959111 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.959339 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.959427 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.959741 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.959825 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.960098 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.960203 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.960429 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.960639 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.960745 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.961053 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.961140 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.961367 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.961519 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.961729 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.962040 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.962124 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.962364 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.962604 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.962695 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.962970 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.963200 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.963296 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.963930 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.964059 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.964378 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.964504 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.964813 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.964915 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.965168 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.965338 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.965493 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.965789 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.965895 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.966132 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.966217 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.966457 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.966681 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.966785 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.967071 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.967158 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.967382 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.967627 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.967721 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.968028 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.968136 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.968332 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.968522 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.968641 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.968953 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.969050 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.969264 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.969402 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.969571 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.969828 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.969914 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.970176 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.970263 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.970505 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.970689 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.970819 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.971111 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.971207 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.971419 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.971561 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.971731 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.972011 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.972114 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.972358 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.972444 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.972668 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.972855 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.972973 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.973278 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.973373 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.973583 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.973738 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.973895 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.974181 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.974287 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.974497 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.974614 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.974803 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.975058 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.975293 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.975462 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.975551 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.975789 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.976075 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.976167 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.976417 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.976517 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.976739 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.976935 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.977050 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.977442 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.977541 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.977911 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.978051 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.978227 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.978478 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.978585 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.978904 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.978993 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.979307 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.979490 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.979753 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.979839 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.980173 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.980274 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.980524 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.980611 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.980865 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.981012 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.981183 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.981448 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.981541 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.981796 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.981916 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.982127 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.982389 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.982485 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.982745 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.982838 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.983059 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.983263 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.983372 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.983686 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.983772 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.984018 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.984190 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.984334 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.984623 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.984717 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.984946 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.985052 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.985366 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.985572 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.985663 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.985884 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.986071 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.986197 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.986506 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.986594 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.986851 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.986936 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.987175 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.987354 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.987495 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.987775 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.987861 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.988153 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.988255 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.988470 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.988681 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.988769 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.989081 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.989165 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.989394 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.989510 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.989710 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.989958 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.990045 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.990345 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.990429 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.990661 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.990832 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.991099 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.991238 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.991418 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.991682 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.991782 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.992078 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.992165 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.992394 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.992563 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.992718 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.993026 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.993202 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.993455 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.993650 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.993883 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.993984 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.994281 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.994365 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.994613 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.994700 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.994960 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.995112 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.995294 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.995602 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.995746 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.995922 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.996117 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.996260 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.996570 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.996655 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.996887 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.996996 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.997213 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.997434 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.997522 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.997822 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.997914 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.998131 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.998306 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.998445 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.998730 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.998816 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.999047 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.999164 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.999356 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.999593 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.999679 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:31.999964 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.000178 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.000350 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.000668 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.000846 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.000962 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.001270 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.002410 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.002511 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.002511 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.002649 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.002715 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.002789 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.002855 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.002929 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.002997 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.003070 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.003137 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.003344 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.003546 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.003649 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.003964 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.004075 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.004324 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.004412 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.004644 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.004849 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.004969 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.005285 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.005416 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.005641 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.005931 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.006028 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.006256 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.006489 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.006576 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.006892 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.006985 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.007211 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.007298 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.007552 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.007731 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.007868 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.008185 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.008302 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.008577 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.008706 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.009076 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.009172 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.009423 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.009613 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.009751 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.009937 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.010057 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.010376 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.010475 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.010693 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.010792 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.011027 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.011230 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.011351 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.011678 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.011802 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.012011 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.012292 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.012379 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.012658 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.012745 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.012975 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.013247 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.013343 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.013597 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.013692 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.013911 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.014096 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.014225 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.014533 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.014629 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.014851 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.015001 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.015182 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.015473 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.015560 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.015816 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.015914 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.016169 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.016435 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.016522 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.016839 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.016935 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.017157 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.017357 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.017504 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.017802 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.017889 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.018142 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.018236 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.018459 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.018660 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.018754 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.019001 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103449) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 20:55:32.019088 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.019471 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.019862 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.020272 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.020667 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.021157 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.021547 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.021926 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.022317 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.022705 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.023079 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.023450 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.023829 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.024319 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.024710 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.025100 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.025473 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.025905 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.026338 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.026747 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.027178 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.027556 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.027944 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.028355 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.028767 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.029149 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.029536 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.029930 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.030306 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.030697 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.031074 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.031445 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.031820 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.032229 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.032648 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.033025 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.033418 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.033820 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.034216 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.034606 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.035050 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.038089 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.038089 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.038089 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.038089 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.038089 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.038089 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.038089 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.038089 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.038953 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.039102 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.039643 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.040341 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.040894 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.041458 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.042043 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.042587 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.043016 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.043404 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.043787 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.044191 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.044649 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.045141 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.045587 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.046063 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.046621 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.047200 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.047692 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.048182 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.048647 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.049668 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.049804 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.050293 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.050679 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.051066 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.051458 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.051844 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.052264 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.052649 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.053107 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.053500 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.054125 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.054521 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.054903 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.055286 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.055717 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.056126 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.056498 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.056976 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.057474 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.057864 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.058246 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.058685 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.059159 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.059557 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.059963 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.060390 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.060773 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.061159 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.061545 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.061969 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.062365 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.062739 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.063192 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.063576 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.063956 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.064415 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.064792 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.065172 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.065556 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.065940 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.066317 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.066683 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.067140 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.067655 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.068152 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.068549 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.068962 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.069346 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.069728 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.070445 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.070828 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.071315 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.071706 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.072131 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.072520 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.072916 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.073391 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.073770 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.074143 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.074523 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.074900 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.075274 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.075662 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.076075 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.076454 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.076842 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.077291 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.077705 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO dbcounter [None req-4eeaa27e-ea45-4b55-a038-ba34df546299 None None] Registered counter for database nova_api Jun 06 20:55:32.078055 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.078497 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.078884 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.079369 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.079766 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.080198 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.080579 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.080972 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.081356 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.081732 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.082119 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.082524 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.082904 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.083290 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.083747 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.084171 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.084548 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.084931 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.085305 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.085700 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.086072 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.086447 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.086867 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.087265 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.087649 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.088079 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.088890 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.089265 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.089680 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.090059 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.090446 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.090825 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.091215 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.091595 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.091977 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.092430 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.092830 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.093206 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.093762 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.094236 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.094759 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.095304 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.095871 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.096486 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.097019 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.097479 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.098176 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.098721 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.099230 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.099732 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.100203 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.100612 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.101040 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.101407 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.101809 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.102175 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.102528 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_db.sqlalchemy.engines [None req-4eeaa27e-ea45-4b55-a038-ba34df546299 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:55:32.102812 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.103288 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.103749 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.104231 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.104682 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.105133 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.105603 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.106087 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.106546 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.106995 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.107447 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.107896 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.108391 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.108905 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.109335 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.109766 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.110098 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writer thread running {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:55:32.110234 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.110598 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.110961 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.111422 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.111891 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.112378 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.112833 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.113301 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.113766 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.114211 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.114788 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.115236 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.115693 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.116184 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.116652 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.117106 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.117564 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.118049 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.118579 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.119044 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.119562 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.120131 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.120608 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.121077 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.121522 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.121973 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.122426 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.122876 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.123333 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.123782 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.124260 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.124782 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.125230 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.125671 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.126113 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.126552 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.127040 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.127495 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.127936 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.128462 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.128926 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.129387 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.129869 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.130381 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.130832 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.131271 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.131721 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.132195 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.132647 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.133161 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.133699 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.134171 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.134720 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.135182 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.135719 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.136196 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.136657 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.137118 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.137576 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.138039 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.138502 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.138970 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.139419 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.139935 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.140505 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.140973 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.141431 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.141882 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.142356 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.142815 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.143260 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.143729 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.144224 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.144694 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.145147 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.145595 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.146086 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.146600 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.147049 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.147500 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.147948 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.148444 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.148910 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.149528 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.150125 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.150525 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.150955 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.151349 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.151748 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.152232 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.152592 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.153011 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.153408 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.153798 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.154179 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.154553 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 20:55:32.154862 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103450) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 20:55:32.170432 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.context [None req-4eeaa27e-ea45-4b55-a038-ba34df546299 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8aa9ac8e-66e4-43b2-82e7-ace0654f5925(cell1) {{(pid=103449) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 20:55:32.175005 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-4eeaa27e-ea45-4b55-a038-ba34df546299 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:32.176494 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-4eeaa27e-ea45-4b55-a038-ba34df546299 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:32.177353 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-4eeaa27e-ea45-4b55-a038-ba34df546299 None None] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:32.179434 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-4eeaa27e-ea45-4b55-a038-ba34df546299 None None] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:32.181723 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO dbcounter [None req-4eeaa27e-ea45-4b55-a038-ba34df546299 None None] Registered counter for database nova_cell0 Jun 06 20:55:32.186406 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO dbcounter [None req-4eeaa27e-ea45-4b55-a038-ba34df546299 None None] Registered counter for database nova_cell1 Jun 06 20:55:32.197223 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_db.sqlalchemy.engines [None req-4eeaa27e-ea45-4b55-a038-ba34df546299 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:55:32.198261 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_db.sqlalchemy.engines [None req-4eeaa27e-ea45-4b55-a038-ba34df546299 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:55:32.206004 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writer thread running {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:55:32.207507 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writer thread running {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:55:32.217212 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO dbcounter [None req-5590e4c9-5823-48bc-829f-c6791f432cdd None None] Registered counter for database nova_api Jun 06 20:55:32.239459 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG oslo_db.sqlalchemy.engines [None req-5590e4c9-5823-48bc-829f-c6791f432cdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:55:32.247487 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG dbcounter [-] [103450] Writer thread running {{(pid=103450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:55:32.308104 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.context [None req-5590e4c9-5823-48bc-829f-c6791f432cdd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8aa9ac8e-66e4-43b2-82e7-ace0654f5925(cell1) {{(pid=103450) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 20:55:32.312582 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG oslo_concurrency.lockutils [None req-5590e4c9-5823-48bc-829f-c6791f432cdd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:32.314324 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG oslo_concurrency.lockutils [None req-5590e4c9-5823-48bc-829f-c6791f432cdd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:32.315244 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG oslo_concurrency.lockutils [None req-5590e4c9-5823-48bc-829f-c6791f432cdd None None] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 20:55:32.317564 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG oslo_concurrency.lockutils [None req-5590e4c9-5823-48bc-829f-c6791f432cdd None None] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103450) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 20:55:32.319744 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO dbcounter [None req-5590e4c9-5823-48bc-829f-c6791f432cdd None None] Registered counter for database nova_cell0 Jun 06 20:55:32.324331 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO dbcounter [None req-5590e4c9-5823-48bc-829f-c6791f432cdd None None] Registered counter for database nova_cell1 Jun 06 20:55:32.334365 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG oslo_db.sqlalchemy.engines [None req-5590e4c9-5823-48bc-829f-c6791f432cdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:55:32.339251 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG oslo_db.sqlalchemy.engines [None req-5590e4c9-5823-48bc-829f-c6791f432cdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:55:32.343000 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG dbcounter [-] [103450] Writer thread running {{(pid=103450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:55:32.349916 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG dbcounter [-] [103450] Writer thread running {{(pid=103450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:55:32.362597 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO dbcounter [None req-4eeaa27e-ea45-4b55-a038-ba34df546299 None None] Registered counter for database nova_cell0 Jun 06 20:55:32.374598 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_db.sqlalchemy.engines [None req-4eeaa27e-ea45-4b55-a038-ba34df546299 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103449) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:55:32.379967 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writer thread running {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:55:32.497199 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO dbcounter [None req-5590e4c9-5823-48bc-829f-c6791f432cdd None None] Registered counter for database nova_cell0 Jun 06 20:55:32.507071 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG oslo_db.sqlalchemy.engines [None req-5590e4c9-5823-48bc-829f-c6791f432cdd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103450) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 20:55:32.512454 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG dbcounter [-] [103450] Writer thread running {{(pid=103450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 20:55:32.883311 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: WARNING keystonemiddleware.auth_token [None req-4eeaa27e-ea45-4b55-a038-ba34df546299 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 20:55:32.891523 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: WARNING keystonemiddleware.auth_token [None req-4eeaa27e-ea45-4b55-a038-ba34df546299 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 20:55:32.966082 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: WARNING keystonemiddleware.auth_token [None req-5590e4c9-5823-48bc-829f-c6791f432cdd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 20:55:32.973558 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: WARNING keystonemiddleware.auth_token [None req-5590e4c9-5823-48bc-829f-c6791f432cdd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 20:55:33.114320 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: WARNING keystonemiddleware.auth_token [None req-4eeaa27e-ea45-4b55-a038-ba34df546299 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 20:55:33.120632 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: WARNING keystonemiddleware.auth_token [None req-4eeaa27e-ea45-4b55-a038-ba34df546299 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 20:55:33.125853 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dc3a72d9c0 pid: 103449 (default app) Jun 06 20:55:33.129344 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-4eeaa27e-ea45-4b55-a038-ba34df546299 None None] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:55:33.130550 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-4eeaa27e-ea45-4b55-a038-ba34df546299 None None] 10.222.0.33 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.003124 Jun 06 20:55:33.130986 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 1/1] 10.222.0.33 () {50 vars in 788 bytes} [Mon Jun 6 20:55:33 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:55:33.194463 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: WARNING keystonemiddleware.auth_token [None req-5590e4c9-5823-48bc-829f-c6791f432cdd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 20:55:33.200686 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: WARNING keystonemiddleware.auth_token [None req-5590e4c9-5823-48bc-829f-c6791f432cdd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 20:55:33.206179 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dc3a72d9c0 pid: 103450 (default app) Jun 06 20:56:57.652559 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-4eeaa27e-ea45-4b55-a038-ba34df546299 None None] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:56:57.653802 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-4eeaa27e-ea45-4b55-a038-ba34df546299 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001781 Jun 06 20:56:57.654275 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 2/2] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 6 20:56:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:56:57.669194 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG dbcounter [-] [103450] Writing DB stats nova_api:SELECT=3 {{(pid=103450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:57.670363 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG dbcounter [-] [103450] Writing DB stats nova_cell0:SELECT=3 {{(pid=103450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:57.671272 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG dbcounter [-] [103450] Writing DB stats nova_cell1:SELECT=3 {{(pid=103450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:57.672255 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG dbcounter [-] [103450] Writing DB stats nova_cell0:SELECT=3 {{(pid=103450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:56:58.265806 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-960aad11-d997-4ead-b928-21095e1c599b admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:56:58.312953 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-960aad11-d997-4ead-b928-21095e1c599b admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.649879 Jun 06 20:56:58.315012 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 1/3] 10.222.0.33 () {60 vars in 1291 bytes} [Mon Jun 6 20:56:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:57:01.163816 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-4eeaa27e-ea45-4b55-a038-ba34df546299 None None] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:01.165383 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-4eeaa27e-ea45-4b55-a038-ba34df546299 None None] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002252 Jun 06 20:57:01.165827 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 3/4] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 6 20:57:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:57:01.238351 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-92389d0a-48db-448a-a9b1-1cb4e527ade4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 1, "name": "cirros256", "id": "c1", "swap": 0, "rxtx_factor": 1.0}} {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:57:01.257569 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 20:57:01.257569 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: warnings.warn(msg) Jun 06 20:57:01.289831 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-92389d0a-48db-448a-a9b1-1cb4e527ade4 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.115335 Jun 06 20:57:01.290817 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 2/5] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jun 6 20:57:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:57:01.523255 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-0691cd1a-3297-4a4f-9e2c-6bf0f4514fb5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:57:01.525821 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 20:57:01.525821 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: warnings.warn(msg) Jun 06 20:57:01.528691 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writing DB stats nova_api:SELECT=3 {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:57:01.529516 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writing DB stats nova_cell0:SELECT=3 {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:57:01.530448 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writing DB stats nova_cell1:SELECT=3 {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:57:01.531342 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:57:01.601240 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-0691cd1a-3297-4a4f-9e2c-6bf0f4514fb5 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.301707 Jun 06 20:57:01.602157 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 4/6] 10.222.0.33 () {64 vars in 1335 bytes} [Mon Jun 6 20:57:01 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:57:03.984202 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-92389d0a-48db-448a-a9b1-1cb4e527ade4 admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:03.985353 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-92389d0a-48db-448a-a9b1-1cb4e527ade4 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001668 Jun 06 20:57:03.985869 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 3/7] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 6 20:57:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:57:04.111979 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-22d51165-255f-429d-8597-2bf28976390c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "os-flavor-access:is_public": true, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d1", "vcpus": 1, "ram": 512, "rxtx_factor": 1.0}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:57:04.133768 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 20:57:04.133768 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: warnings.warn(msg) Jun 06 20:57:04.171616 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-22d51165-255f-429d-8597-2bf28976390c admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.178584 Jun 06 20:57:04.179624 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 5/8] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jun 6 20:57:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:57:04.185778 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-3606ae34-a1f2-4e4c-8c9b-4c076f9b186f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:57:04.188347 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 20:57:04.188347 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: warnings.warn(msg) Jun 06 20:57:04.229154 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-3606ae34-a1f2-4e4c-8c9b-4c076f9b186f admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047493 Jun 06 20:57:04.229749 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 4/9] 10.222.0.33 () {64 vars in 1335 bytes} [Mon Jun 6 20:57:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:57:07.112197 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-22d51165-255f-429d-8597-2bf28976390c admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:07.113248 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-22d51165-255f-429d-8597-2bf28976390c admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001645 Jun 06 20:57:07.114312 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 6/10] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 6 20:57:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:57:07.218073 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-bd2a5983-467e-4f54-9cc0-6393df503c3e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 1024}} {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:57:07.244556 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-bd2a5983-467e-4f54-9cc0-6393df503c3e admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.120111 Jun 06 20:57:07.253135 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 5/11] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jun 6 20:57:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:57:07.265050 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-4f2ae711-c7c4-45bc-8bce-c08d41a94004 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:57:07.292593 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-4f2ae711-c7c4-45bc-8bce-c08d41a94004 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034081 Jun 06 20:57:07.300078 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 7/12] 10.222.0.33 () {64 vars in 1335 bytes} [Mon Jun 6 20:57:07 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:57:09.803677 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-bd2a5983-467e-4f54-9cc0-6393df503c3e admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:09.804753 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-bd2a5983-467e-4f54-9cc0-6393df503c3e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Jun 06 20:57:09.805393 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 6/13] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 6 20:57:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:57:09.887527 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-6817cbf5-5fc0-457d-ae26-11caafa2a821 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "d3", "vcpus": 2, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds2G", "rxtx_factor": 1.0}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:57:09.909574 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-6817cbf5-5fc0-457d-ae26-11caafa2a821 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.097530 Jun 06 20:57:09.910139 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 8/14] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jun 6 20:57:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 20:57:09.927610 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-3d2175d5-b5df-4495-b9e5-46f387da40b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:57:09.961877 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-3d2175d5-b5df-4495-b9e5-46f387da40b0 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041863 Jun 06 20:57:09.962478 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 7/15] 10.222.0.33 () {64 vars in 1335 bytes} [Mon Jun 6 20:57:09 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:57:12.451478 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-6817cbf5-5fc0-457d-ae26-11caafa2a821 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:12.453426 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-6817cbf5-5fc0-457d-ae26-11caafa2a821 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002673 Jun 06 20:57:12.454144 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 9/16] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 6 20:57:12 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:57:12.520355 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-be191417-458c-4561-9123-d9f31041d03a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "ram": 4096, "id": "d4", "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:57:12.540246 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-be191417-458c-4561-9123-d9f31041d03a admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076597 Jun 06 20:57:12.540818 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 8/17] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jun 6 20:57:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:57:12.552806 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-5eff0fe8-4c6b-48d7-a7bb-33c4013e28d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:57:12.580896 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-5eff0fe8-4c6b-48d7-a7bb-33c4013e28d6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031552 Jun 06 20:57:12.582126 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 10/18] 10.222.0.33 () {64 vars in 1335 bytes} [Mon Jun 6 20:57:12 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 20:57:15.037095 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-be191417-458c-4561-9123-d9f31041d03a admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:15.038934 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-be191417-458c-4561-9123-d9f31041d03a admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002268 Jun 06 20:57:15.042874 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 9/19] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 6 20:57:15 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:57:15.113170 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-0a186fa5-399d-438e-9983-520df3e6fb3e admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:15.143252 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-0a186fa5-399d-438e-9983-520df3e6fb3e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.092474 Jun 06 20:57:15.144174 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 11/20] 10.222.0.33 () {60 vars in 1291 bytes} [Mon Jun 6 20:57:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:57:17.822242 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-be191417-458c-4561-9123-d9f31041d03a admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:17.823471 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-be191417-458c-4561-9123-d9f31041d03a admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001875 Jun 06 20:57:17.824245 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 10/21] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 6 20:57:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:57:17.900167 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-0e0c6f50-f934-4668-b4bb-b7a58cd79d8d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "id": "1", "name": "m1.tiny", "vcpus": 1}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:57:17.921546 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-0e0c6f50-f934-4668-b4bb-b7a58cd79d8d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.089735 Jun 06 20:57:17.922115 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 12/22] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jun 6 20:57:17 2022] POST /compute/v2.1/flavors => generated 402 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 20:57:17.936636 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-b69b836a-20cc-4964-8fde-39747ce5eb9d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:57:17.967786 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-b69b836a-20cc-4964-8fde-39747ce5eb9d admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034326 Jun 06 20:57:17.970019 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 11/23] 10.222.0.33 () {64 vars in 1332 bytes} [Mon Jun 6 20:57:17 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:57:20.571840 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-0e0c6f50-f934-4668-b4bb-b7a58cd79d8d admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:20.572907 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-0e0c6f50-f934-4668-b4bb-b7a58cd79d8d admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jun 06 20:57:20.573317 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 13/24] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 6 20:57:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:57:20.642456 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-7b1bdf8b-9a88-4963-b551-336cb9fd7fb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "2", "os-flavor-access:is_public": true, "ram": 2048, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 1}} {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:57:20.664354 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-7b1bdf8b-9a88-4963-b551-336cb9fd7fb7 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.084423 Jun 06 20:57:20.664831 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 12/25] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jun 6 20:57:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 20:57:20.677823 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-11e6b7d8-c785-485b-bc50-b0e69b47fd69 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:57:20.704737 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-11e6b7d8-c785-485b-bc50-b0e69b47fd69 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031105 Jun 06 20:57:20.705330 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 14/26] 10.222.0.33 () {64 vars in 1332 bytes} [Mon Jun 6 20:57:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:57:23.257849 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-7b1bdf8b-9a88-4963-b551-336cb9fd7fb7 admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:23.258902 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-7b1bdf8b-9a88-4963-b551-336cb9fd7fb7 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Jun 06 20:57:23.259478 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 13/27] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 6 20:57:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:57:23.323718 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-990486e9-b4d9-47c8-bce7-e378da0ba5ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.medium", "id": "3", "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:57:23.343488 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-990486e9-b4d9-47c8-bce7-e378da0ba5ad admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.077833 Jun 06 20:57:23.344198 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 15/28] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jun 6 20:57:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:57:23.357020 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-5d235d42-1cfb-4d38-8097-8aa5d15e0190 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:57:23.382064 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-5d235d42-1cfb-4d38-8097-8aa5d15e0190 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028890 Jun 06 20:57:23.382657 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 14/29] 10.222.0.33 () {64 vars in 1332 bytes} [Mon Jun 6 20:57:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:57:25.734129 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-990486e9-b4d9-47c8-bce7-e378da0ba5ad admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:25.735272 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-990486e9-b4d9-47c8-bce7-e378da0ba5ad admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Jun 06 20:57:25.735765 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 16/30] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 6 20:57:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:57:25.797213 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-28e49e9d-9704-44ac-88a7-0abcdd0288ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "rxtx_factor": 1.0, "ram": 8192, "swap": 0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "m1.large"}} {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:57:25.823260 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-28e49e9d-9704-44ac-88a7-0abcdd0288ed admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.080418 Jun 06 20:57:25.824208 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 15/31] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jun 6 20:57:25 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:57:25.845412 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-b4ee57a2-a94b-4098-b170-300ad0d62427 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:57:25.874049 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-b4ee57a2-a94b-4098-b170-300ad0d62427 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032228 Jun 06 20:57:25.874648 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 17/32] 10.222.0.33 () {64 vars in 1332 bytes} [Mon Jun 6 20:57:25 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:57:28.297421 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-28e49e9d-9704-44ac-88a7-0abcdd0288ed admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:28.298353 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-28e49e9d-9704-44ac-88a7-0abcdd0288ed admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Jun 06 20:57:28.298914 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 16/33] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 6 20:57:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:57:28.371132 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-cb21bcc2-22c7-40cb-b095-ffceb7d8dfea admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 8, "rxtx_factor": 1.0, "id": "5", "disk": 160, "ram": 16384, "name": "m1.xlarge", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:57:28.392172 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-cb21bcc2-22c7-40cb-b095-ffceb7d8dfea admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.086421 Jun 06 20:57:28.393045 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 18/34] 10.222.0.33 () {64 vars in 1282 bytes} [Mon Jun 6 20:57:28 2022] POST /compute/v2.1/flavors => generated 408 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:57:28.404576 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-a4952ff1-5956-40c9-99aa-4beb338343d6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:57:28.408242 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG dbcounter [-] [103450] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:57:28.435966 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-a4952ff1-5956-40c9-99aa-4beb338343d6 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034962 Jun 06 20:57:28.436719 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 17/35] 10.222.0.33 () {64 vars in 1332 bytes} [Mon Jun 6 20:57:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:57:51.931617 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-cb21bcc2-22c7-40cb-b095-ffceb7d8dfea admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:51.932678 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-cb21bcc2-22c7-40cb-b095-ffceb7d8dfea admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jun 06 20:57:51.933072 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 19/36] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 6 20:57:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:57:51.944674 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG dbcounter [-] [103450] Writing DB stats nova_api:SELECT=5,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:57:51.995841 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-121bd738-410a-4e7c-9c7d-bcc91f7f003e admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:52.015507 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-121bd738-410a-4e7c-9c7d-bcc91f7f003e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.075931 Jun 06 20:57:52.016049 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 18/37] 10.222.0.33 () {60 vars in 1291 bytes} [Mon Jun 6 20:57:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:57:53.043122 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-cb21bcc2-22c7-40cb-b095-ffceb7d8dfea admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:53.044178 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-cb21bcc2-22c7-40cb-b095-ffceb7d8dfea admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jun 06 20:57:53.044576 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 20/38] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 6 20:57:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:57:53.250890 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-85468ec0-af29-4844-9de3-2750d3eacf0a admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:53.257964 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.wsgi [None req-85468ec0-af29-4844-9de3-2750d3eacf0a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 06 20:57:53.261337 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-85468ec0-af29-4844-9de3-2750d3eacf0a admin admin] Request method failure captured: Jun 06 20:57:53.261337 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 06 20:57:53.261337 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: Accept: application/json Jun 06 20:57:53.261337 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: Accept-Encoding: gzip, deflate Jun 06 20:57:53.261337 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: Connection: keep-alive Jun 06 20:57:53.261337 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: Content-Length: 0 Jun 06 20:57:53.261337 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: Host: 10.222.0.33 Jun 06 20:57:53.261337 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: Openstack-Api-Version: compute 2.90 Jun 06 20:57:53.261337 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: Openstack-System-Scope: None Jun 06 20:57:53.261337 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: User-Agent: python-novaclient Jun 06 20:57:53.261337 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Auth-Token: gAAAAABinmpRoImpUsMYuGbhjdqHH8J87sxZIY7w2Z6yuARMCMqEHcPZavw_VqZhZFOlQCESW9PoDAvllnATDUasODePSc2Ae6qYHEydMpdY2K8u_jnRDOJ7aKj0-7aunQgt4w2mnCznYRvlSF7EHROMfs8H6JL-WXX_skbtb6i_LqTkzmHGAVo Jun 06 20:57:53.261337 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Domain-Id: None Jun 06 20:57:53.261337 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Domain-Name: None Jun 06 20:57:53.261337 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Identity-Status: Confirmed Jun 06 20:57:53.261337 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Is-Admin-Project: True Jun 06 20:57:53.261337 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 20:57:53.261337 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Project-Domain-Id: default Jun 06 20:57:53.261337 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Project-Domain-Name: Default Jun 06 20:57:53.261337 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Project-Id: 975471a492db48b49b1c3d1741da2fcb Jun 06 20:57:53.261337 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Project-Name: admin Jun 06 20:57:53.261337 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Role: admin,reader,member Jun 06 20:57:53.261337 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Roles: admin,reader,member Jun 06 20:57:53.262893 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 20:57:53.262893 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Tenant: admin Jun 06 20:57:53.262893 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Tenant-Id: 975471a492db48b49b1c3d1741da2fcb Jun 06 20:57:53.262893 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Tenant-Name: admin Jun 06 20:57:53.262893 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-User: admin Jun 06 20:57:53.262893 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-User-Domain-Id: default Jun 06 20:57:53.262893 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-User-Domain-Name: Default Jun 06 20:57:53.262893 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-User-Id: d45573389f8249aaa5d35d830a5a6625 Jun 06 20:57:53.262893 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-User-Name: admin Jun 06 20:57:53.262893 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: method: > Jun 06 20:57:53.262893 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: exception: Flavor 42 could not be found. Jun 06 20:57:53.262893 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: action_args: {'id': '42'} Jun 06 20:57:53.262893 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:57:53.262893 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:57:53.263870 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 20:57:53.263870 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 20:57:53.263870 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 20:57:53.263870 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 20:57:53.263870 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 20:57:53.263870 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 20:57:53.263870 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 20:57:53.263870 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 20:57:53.263870 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 20:57:53.263870 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:57:53.263870 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 20:57:53.263870 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 20:57:53.263870 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 06 20:57:53.263870 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Jun 06 20:57:53.263870 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:57:53.263870 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Jun 06 20:57:53.263870 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:57:53.263870 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:57:53.263870 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:57:53.265075 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:57:53.265075 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:57:53.265075 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:57:53.265075 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:57:53.265075 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 20:57:53.265075 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:57:53.265075 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 06 20:57:53.265075 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Jun 06 20:57:53.265075 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:57:53.265075 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Jun 06 20:57:53.265075 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:57:53.265075 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:57:53.265075 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:57:53.265075 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:57:53.265075 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:57:53.265075 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 06 20:57:53.265075 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Jun 06 20:57:53.265075 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-85468ec0-af29-4844-9de3-2750d3eacf0a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:57:53.266133 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-85468ec0-af29-4844-9de3-2750d3eacf0a admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.069269 Jun 06 20:57:53.266133 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 19/39] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Jun 6 20:57:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:53.273574 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-e7bbf6d1-5535-4364-9a87-efdad6f0e4cb admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:53.277721 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:57:53.299305 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-e7bbf6d1-5535-4364-9a87-efdad6f0e4cb admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029347 Jun 06 20:57:53.300558 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 21/40] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jun 6 20:57:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:57:53.316639 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-7b413218-9425-49c4-8e21-a6d704028bba admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:53.338884 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-7b413218-9425-49c4-8e21-a6d704028bba admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026634 Jun 06 20:57:53.339437 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 20/41] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jun 6 20:57:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:57:53.349674 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-9d5c015a-f307-4b66-86ad-9d803749b578 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:53.356096 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.wsgi [None req-9d5c015a-f307-4b66-86ad-9d803749b578 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 06 20:57:53.359478 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-9d5c015a-f307-4b66-86ad-9d803749b578 admin admin] Request method failure captured: Jun 06 20:57:53.359478 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 06 20:57:53.359478 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: Accept: application/json Jun 06 20:57:53.359478 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: Accept-Encoding: gzip, deflate Jun 06 20:57:53.359478 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: Connection: keep-alive Jun 06 20:57:53.359478 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: Content-Length: 0 Jun 06 20:57:53.359478 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: Host: 10.222.0.33 Jun 06 20:57:53.359478 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: Openstack-Api-Version: compute 2.90 Jun 06 20:57:53.359478 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: Openstack-System-Scope: None Jun 06 20:57:53.359478 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: User-Agent: python-novaclient Jun 06 20:57:53.359478 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Auth-Token: gAAAAABinmpRoImpUsMYuGbhjdqHH8J87sxZIY7w2Z6yuARMCMqEHcPZavw_VqZhZFOlQCESW9PoDAvllnATDUasODePSc2Ae6qYHEydMpdY2K8u_jnRDOJ7aKj0-7aunQgt4w2mnCznYRvlSF7EHROMfs8H6JL-WXX_skbtb6i_LqTkzmHGAVo Jun 06 20:57:53.359478 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Domain-Id: None Jun 06 20:57:53.359478 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Domain-Name: None Jun 06 20:57:53.359478 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Identity-Status: Confirmed Jun 06 20:57:53.359478 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Is-Admin-Project: True Jun 06 20:57:53.359478 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 20:57:53.359478 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Project-Domain-Id: default Jun 06 20:57:53.359478 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Project-Domain-Name: Default Jun 06 20:57:53.359478 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Project-Id: 975471a492db48b49b1c3d1741da2fcb Jun 06 20:57:53.359478 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Project-Name: admin Jun 06 20:57:53.359478 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Role: admin,reader,member Jun 06 20:57:53.359478 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Roles: admin,reader,member Jun 06 20:57:53.360993 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 20:57:53.360993 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Tenant: admin Jun 06 20:57:53.360993 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Tenant-Id: 975471a492db48b49b1c3d1741da2fcb Jun 06 20:57:53.360993 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Tenant-Name: admin Jun 06 20:57:53.360993 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-User: admin Jun 06 20:57:53.360993 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-User-Domain-Id: default Jun 06 20:57:53.360993 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-User-Domain-Name: Default Jun 06 20:57:53.360993 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-User-Id: d45573389f8249aaa5d35d830a5a6625 Jun 06 20:57:53.360993 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-User-Name: admin Jun 06 20:57:53.360993 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: method: > Jun 06 20:57:53.360993 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: exception: Flavor 42 could not be found. Jun 06 20:57:53.360993 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: action_args: {'id': '42'} Jun 06 20:57:53.360993 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:57:53.360993 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:57:53.361906 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 20:57:53.361906 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 20:57:53.361906 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 20:57:53.361906 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 20:57:53.361906 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 20:57:53.361906 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 20:57:53.361906 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 20:57:53.361906 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 20:57:53.361906 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 20:57:53.361906 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:57:53.361906 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 20:57:53.361906 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 20:57:53.361906 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 06 20:57:53.361906 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 06 20:57:53.361906 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:57:53.361906 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 06 20:57:53.361906 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:57:53.361906 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:57:53.361906 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:57:53.363647 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:57:53.363647 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:57:53.363647 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:57:53.363647 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:57:53.363647 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 20:57:53.363647 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:57:53.363647 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 06 20:57:53.363647 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 06 20:57:53.363647 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:57:53.363647 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 06 20:57:53.363647 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:57:53.363647 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:57:53.363647 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:57:53.363647 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:57:53.363647 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:57:53.363647 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 06 20:57:53.363647 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 06 20:57:53.363647 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-9d5c015a-f307-4b66-86ad-9d803749b578 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:57:53.364667 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-9d5c015a-f307-4b66-86ad-9d803749b578 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015415 Jun 06 20:57:53.364667 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 22/42] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Jun 6 20:57:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:54.231167 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-7b413218-9425-49c4-8e21-a6d704028bba admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:54.232237 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-7b413218-9425-49c4-8e21-a6d704028bba admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 06 20:57:54.232648 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 21/43] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 6 20:57:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:57:54.428571 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-af478d39-62c4-4aca-832c-77bc88abc9e0 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:54.434602 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.wsgi [None req-af478d39-62c4-4aca-832c-77bc88abc9e0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 06 20:57:54.436145 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-af478d39-62c4-4aca-832c-77bc88abc9e0 admin admin] Request method failure captured: Jun 06 20:57:54.436145 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 06 20:57:54.436145 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: Accept: application/json Jun 06 20:57:54.436145 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: Accept-Encoding: gzip, deflate Jun 06 20:57:54.436145 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: Connection: keep-alive Jun 06 20:57:54.436145 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: Content-Length: 0 Jun 06 20:57:54.436145 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: Host: 10.222.0.33 Jun 06 20:57:54.436145 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: Openstack-Api-Version: compute 2.90 Jun 06 20:57:54.436145 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: Openstack-System-Scope: None Jun 06 20:57:54.436145 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: User-Agent: python-novaclient Jun 06 20:57:54.436145 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Auth-Token: gAAAAABinmpS4R68aD0MCC5zL0WkUKKXRMNf4eb07v0T6J7EeO1j31V8QTthJ9XKwhNu5Fjj-2Ylby-pYxB0U0BYadYhVqsvBLkmTtyPrSg8s16rStZuMLExC_7UFHUz8f26Wy9Hn129ReCqdCle3SCSiYCDu05PSLkmfoIaxkaInQ982wAgQiA Jun 06 20:57:54.436145 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Domain-Id: None Jun 06 20:57:54.436145 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Domain-Name: None Jun 06 20:57:54.436145 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Identity-Status: Confirmed Jun 06 20:57:54.436145 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Is-Admin-Project: True Jun 06 20:57:54.436145 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 20:57:54.436145 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Project-Domain-Id: default Jun 06 20:57:54.436145 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Project-Domain-Name: Default Jun 06 20:57:54.436145 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Project-Id: 975471a492db48b49b1c3d1741da2fcb Jun 06 20:57:54.436145 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Project-Name: admin Jun 06 20:57:54.436145 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Role: admin,reader,member Jun 06 20:57:54.436145 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Roles: admin,reader,member Jun 06 20:57:54.437752 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 20:57:54.437752 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Tenant: admin Jun 06 20:57:54.437752 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Tenant-Id: 975471a492db48b49b1c3d1741da2fcb Jun 06 20:57:54.437752 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Tenant-Name: admin Jun 06 20:57:54.437752 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-User: admin Jun 06 20:57:54.437752 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-User-Domain-Id: default Jun 06 20:57:54.437752 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-User-Domain-Name: Default Jun 06 20:57:54.437752 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-User-Id: d45573389f8249aaa5d35d830a5a6625 Jun 06 20:57:54.437752 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-User-Name: admin Jun 06 20:57:54.437752 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: method: > Jun 06 20:57:54.437752 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: exception: Flavor 84 could not be found. Jun 06 20:57:54.437752 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: action_args: {'id': '84'} Jun 06 20:57:54.437752 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:57:54.437752 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:57:54.438807 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 20:57:54.438807 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 20:57:54.438807 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 20:57:54.438807 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 20:57:54.438807 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 20:57:54.438807 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 20:57:54.438807 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 20:57:54.438807 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 20:57:54.438807 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 20:57:54.438807 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:57:54.438807 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 20:57:54.438807 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 20:57:54.438807 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 06 20:57:54.438807 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 06 20:57:54.438807 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:57:54.438807 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 06 20:57:54.438807 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:57:54.438807 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:57:54.438807 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:57:54.440210 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:57:54.440210 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:57:54.440210 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:57:54.440210 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:57:54.440210 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 20:57:54.440210 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:57:54.440210 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 06 20:57:54.440210 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 06 20:57:54.440210 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:57:54.440210 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 06 20:57:54.440210 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:57:54.440210 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:57:54.440210 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:57:54.440210 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:57:54.440210 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:57:54.440210 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 06 20:57:54.440210 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 06 20:57:54.440210 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-af478d39-62c4-4aca-832c-77bc88abc9e0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:57:54.441529 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-af478d39-62c4-4aca-832c-77bc88abc9e0 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.068397 Jun 06 20:57:54.441529 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 23/44] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Jun 6 20:57:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:54.448260 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-418512b2-567b-41ec-8175-82f8cdca6142 admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:54.462997 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-418512b2-567b-41ec-8175-82f8cdca6142 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018452 Jun 06 20:57:54.463560 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 22/45] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jun 6 20:57:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:57:54.473589 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-7e524105-e0f5-4757-8456-09a4de820b72 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:54.487844 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-7e524105-e0f5-4757-8456-09a4de820b72 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017893 Jun 06 20:57:54.488442 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 24/46] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jun 6 20:57:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:57:54.498177 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-2f0135fb-31ed-4448-bc79-b72b0252f56e admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:54.504480 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.wsgi [None req-2f0135fb-31ed-4448-bc79-b72b0252f56e admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 06 20:57:54.506028 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-2f0135fb-31ed-4448-bc79-b72b0252f56e admin admin] Request method failure captured: Jun 06 20:57:54.506028 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 06 20:57:54.506028 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: Accept: application/json Jun 06 20:57:54.506028 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: Accept-Encoding: gzip, deflate Jun 06 20:57:54.506028 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: Connection: keep-alive Jun 06 20:57:54.506028 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: Content-Length: 0 Jun 06 20:57:54.506028 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: Host: 10.222.0.33 Jun 06 20:57:54.506028 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: Openstack-Api-Version: compute 2.90 Jun 06 20:57:54.506028 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: Openstack-System-Scope: None Jun 06 20:57:54.506028 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: User-Agent: python-novaclient Jun 06 20:57:54.506028 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Auth-Token: gAAAAABinmpS4R68aD0MCC5zL0WkUKKXRMNf4eb07v0T6J7EeO1j31V8QTthJ9XKwhNu5Fjj-2Ylby-pYxB0U0BYadYhVqsvBLkmTtyPrSg8s16rStZuMLExC_7UFHUz8f26Wy9Hn129ReCqdCle3SCSiYCDu05PSLkmfoIaxkaInQ982wAgQiA Jun 06 20:57:54.506028 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Domain-Id: None Jun 06 20:57:54.506028 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Domain-Name: None Jun 06 20:57:54.506028 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Identity-Status: Confirmed Jun 06 20:57:54.506028 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Is-Admin-Project: True Jun 06 20:57:54.506028 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 20:57:54.506028 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Project-Domain-Id: default Jun 06 20:57:54.506028 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Project-Domain-Name: Default Jun 06 20:57:54.506028 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Project-Id: 975471a492db48b49b1c3d1741da2fcb Jun 06 20:57:54.506028 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Project-Name: admin Jun 06 20:57:54.506028 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Role: admin,reader,member Jun 06 20:57:54.506028 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Roles: admin,reader,member Jun 06 20:57:54.507558 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 20:57:54.507558 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Tenant: admin Jun 06 20:57:54.507558 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Tenant-Id: 975471a492db48b49b1c3d1741da2fcb Jun 06 20:57:54.507558 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Tenant-Name: admin Jun 06 20:57:54.507558 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-User: admin Jun 06 20:57:54.507558 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-User-Domain-Id: default Jun 06 20:57:54.507558 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-User-Domain-Name: Default Jun 06 20:57:54.507558 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-User-Id: d45573389f8249aaa5d35d830a5a6625 Jun 06 20:57:54.507558 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-User-Name: admin Jun 06 20:57:54.507558 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: method: > Jun 06 20:57:54.507558 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: exception: Flavor 84 could not be found. Jun 06 20:57:54.507558 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: action_args: {'id': '84'} Jun 06 20:57:54.507558 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:57:54.507558 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:57:54.508694 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 20:57:54.508694 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 20:57:54.508694 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 20:57:54.508694 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 20:57:54.508694 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 20:57:54.508694 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 20:57:54.508694 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 20:57:54.508694 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 20:57:54.508694 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 20:57:54.508694 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:57:54.508694 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 20:57:54.508694 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 20:57:54.508694 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 06 20:57:54.508694 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Jun 06 20:57:54.508694 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:57:54.508694 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Jun 06 20:57:54.508694 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:57:54.508694 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:57:54.508694 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:57:54.510389 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:57:54.510389 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:57:54.510389 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:57:54.510389 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:57:54.510389 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 20:57:54.510389 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:57:54.510389 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 06 20:57:54.510389 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Jun 06 20:57:54.510389 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:57:54.510389 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Jun 06 20:57:54.510389 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:57:54.510389 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:57:54.510389 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:57:54.510389 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:57:54.510389 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:57:54.510389 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 06 20:57:54.510389 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Jun 06 20:57:54.510389 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-2f0135fb-31ed-4448-bc79-b72b0252f56e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:57:54.511729 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-2f0135fb-31ed-4448-bc79-b72b0252f56e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012962 Jun 06 20:57:54.511729 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 23/47] 10.222.0.33 () {60 vars in 1190 bytes} [Mon Jun 6 20:57:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:55.382770 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-7e524105-e0f5-4757-8456-09a4de820b72 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:55.383823 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-7e524105-e0f5-4757-8456-09a4de820b72 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jun 06 20:57:55.384254 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 25/48] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 6 20:57:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:57:55.581862 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-f408ca21-8840-4965-9caa-ec15edced164 admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:55.588334 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.wsgi [None req-f408ca21-8840-4965-9caa-ec15edced164 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 06 20:57:55.589794 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-f408ca21-8840-4965-9caa-ec15edced164 admin admin] Request method failure captured: Jun 06 20:57:55.589794 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 06 20:57:55.589794 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: Accept: application/json Jun 06 20:57:55.589794 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: Accept-Encoding: gzip, deflate Jun 06 20:57:55.589794 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: Connection: keep-alive Jun 06 20:57:55.589794 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: Content-Length: 0 Jun 06 20:57:55.589794 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: Host: 10.222.0.33 Jun 06 20:57:55.589794 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: Openstack-Api-Version: compute 2.90 Jun 06 20:57:55.589794 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: Openstack-System-Scope: None Jun 06 20:57:55.589794 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: User-Agent: python-novaclient Jun 06 20:57:55.589794 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Auth-Token: gAAAAABinmpTouHr20RhfCrv9RYweEmw0CO0CiU1gGwkmToTlosv517BlzPyUHVx6I9vGKkVrUhCPk6zYQzFDty2de6k83cEspUDgbveNMi8fXyvBpBgGUlk87cafVJV8E4UNXcTBQtlnU90tvWTifzs5bq-uQFPVT8azqDHjAIyYN_lhkyR5AE Jun 06 20:57:55.589794 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Domain-Id: None Jun 06 20:57:55.589794 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Domain-Name: None Jun 06 20:57:55.589794 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Identity-Status: Confirmed Jun 06 20:57:55.589794 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Is-Admin-Project: True Jun 06 20:57:55.589794 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 20:57:55.589794 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Project-Domain-Id: default Jun 06 20:57:55.589794 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Project-Domain-Name: Default Jun 06 20:57:55.589794 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Project-Id: 975471a492db48b49b1c3d1741da2fcb Jun 06 20:57:55.589794 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Project-Name: admin Jun 06 20:57:55.589794 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Role: admin,reader,member Jun 06 20:57:55.589794 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Roles: admin,reader,member Jun 06 20:57:55.591310 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 20:57:55.591310 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Tenant: admin Jun 06 20:57:55.591310 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Tenant-Id: 975471a492db48b49b1c3d1741da2fcb Jun 06 20:57:55.591310 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-Tenant-Name: admin Jun 06 20:57:55.591310 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-User: admin Jun 06 20:57:55.591310 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-User-Domain-Id: default Jun 06 20:57:55.591310 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-User-Domain-Name: Default Jun 06 20:57:55.591310 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-User-Id: d45573389f8249aaa5d35d830a5a6625 Jun 06 20:57:55.591310 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: X-User-Name: admin Jun 06 20:57:55.591310 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: method: > Jun 06 20:57:55.591310 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: exception: Flavor 451 could not be found. Jun 06 20:57:55.591310 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: action_args: {'id': '451'} Jun 06 20:57:55.591310 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:57:55.591310 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:57:55.592542 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 20:57:55.592542 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 20:57:55.592542 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 20:57:55.592542 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 20:57:55.592542 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 20:57:55.592542 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 20:57:55.592542 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 20:57:55.592542 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 20:57:55.592542 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 20:57:55.592542 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:57:55.592542 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 20:57:55.592542 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 20:57:55.592542 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 06 20:57:55.592542 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Jun 06 20:57:55.592542 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:57:55.592542 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Jun 06 20:57:55.592542 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:57:55.592542 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:57:55.592542 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:57:55.593792 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:57:55.593792 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:57:55.593792 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:57:55.593792 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:57:55.593792 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 20:57:55.593792 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:57:55.593792 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 06 20:57:55.593792 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Jun 06 20:57:55.593792 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:57:55.593792 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Jun 06 20:57:55.593792 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:57:55.593792 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:57:55.593792 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:57:55.593792 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:57:55.593792 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:57:55.593792 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 06 20:57:55.593792 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: ERROR nova.api.openstack.wsgi Jun 06 20:57:55.593792 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-f408ca21-8840-4965-9caa-ec15edced164 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103450) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:57:55.595013 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-f408ca21-8840-4965-9caa-ec15edced164 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.067270 Jun 06 20:57:55.595013 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 24/49] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jun 6 20:57:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:55.601535 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-006dd52c-5eaa-410d-a7b9-bc5e11e56805 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:55.616325 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-006dd52c-5eaa-410d-a7b9-bc5e11e56805 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018414 Jun 06 20:57:55.616889 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 26/50] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jun 6 20:57:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 20:57:55.626778 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-5fcc442a-fd02-474b-b274-c4bce2ab819e admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:55.641285 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-5fcc442a-fd02-474b-b274-c4bce2ab819e admin admin] 10.222.0.33 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017980 Jun 06 20:57:55.641854 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 25/51] 10.222.0.33 () {60 vars in 1210 bytes} [Mon Jun 6 20:57:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:57:55.651688 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-6929f617-7454-4980-8576-5c41d83a66f8 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:55.657524 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.wsgi [None req-6929f617-7454-4980-8576-5c41d83a66f8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 06 20:57:55.659166 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-6929f617-7454-4980-8576-5c41d83a66f8 admin admin] Request method failure captured: Jun 06 20:57:55.659166 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 06 20:57:55.659166 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: Accept: application/json Jun 06 20:57:55.659166 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: Accept-Encoding: gzip, deflate Jun 06 20:57:55.659166 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: Connection: keep-alive Jun 06 20:57:55.659166 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: Content-Length: 0 Jun 06 20:57:55.659166 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: Host: 10.222.0.33 Jun 06 20:57:55.659166 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: Openstack-Api-Version: compute 2.90 Jun 06 20:57:55.659166 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: Openstack-System-Scope: None Jun 06 20:57:55.659166 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: User-Agent: python-novaclient Jun 06 20:57:55.659166 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Auth-Token: gAAAAABinmpTouHr20RhfCrv9RYweEmw0CO0CiU1gGwkmToTlosv517BlzPyUHVx6I9vGKkVrUhCPk6zYQzFDty2de6k83cEspUDgbveNMi8fXyvBpBgGUlk87cafVJV8E4UNXcTBQtlnU90tvWTifzs5bq-uQFPVT8azqDHjAIyYN_lhkyR5AE Jun 06 20:57:55.659166 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Domain-Id: None Jun 06 20:57:55.659166 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Domain-Name: None Jun 06 20:57:55.659166 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Identity-Status: Confirmed Jun 06 20:57:55.659166 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Is-Admin-Project: True Jun 06 20:57:55.659166 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 20:57:55.659166 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Project-Domain-Id: default Jun 06 20:57:55.659166 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Project-Domain-Name: Default Jun 06 20:57:55.659166 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Project-Id: 975471a492db48b49b1c3d1741da2fcb Jun 06 20:57:55.659166 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Project-Name: admin Jun 06 20:57:55.659166 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Role: admin,reader,member Jun 06 20:57:55.659166 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Roles: admin,reader,member Jun 06 20:57:55.660886 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/975471a492db48b49b1c3d1741da2fcb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 20:57:55.660886 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Tenant: admin Jun 06 20:57:55.660886 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Tenant-Id: 975471a492db48b49b1c3d1741da2fcb Jun 06 20:57:55.660886 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-Tenant-Name: admin Jun 06 20:57:55.660886 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-User: admin Jun 06 20:57:55.660886 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-User-Domain-Id: default Jun 06 20:57:55.660886 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-User-Domain-Name: Default Jun 06 20:57:55.660886 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-User-Id: d45573389f8249aaa5d35d830a5a6625 Jun 06 20:57:55.660886 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: X-User-Name: admin Jun 06 20:57:55.660886 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: method: > Jun 06 20:57:55.660886 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: exception: Flavor 451 could not be found. Jun 06 20:57:55.660886 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: action_args: {'id': '451'} Jun 06 20:57:55.660886 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 20:57:55.660886 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:57:55.661840 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 20:57:55.661840 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 20:57:55.661840 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 20:57:55.661840 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 20:57:55.661840 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 20:57:55.661840 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 20:57:55.661840 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 20:57:55.661840 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 20:57:55.661840 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 20:57:55.661840 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:57:55.661840 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 20:57:55.661840 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 20:57:55.661840 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 06 20:57:55.661840 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 06 20:57:55.661840 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:57:55.661840 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 06 20:57:55.661840 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:57:55.661840 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:57:55.661840 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:57:55.663022 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 20:57:55.663022 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 20:57:55.663022 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 20:57:55.663022 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 20:57:55.663022 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 20:57:55.663022 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 20:57:55.663022 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 06 20:57:55.663022 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 06 20:57:55.663022 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 20:57:55.663022 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 06 20:57:55.663022 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 20:57:55.663022 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 20:57:55.663022 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 20:57:55.663022 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 20:57:55.663022 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 20:57:55.663022 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 06 20:57:55.663022 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: ERROR nova.api.openstack.wsgi Jun 06 20:57:55.663022 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-6929f617-7454-4980-8576-5c41d83a66f8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103449) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 20:57:55.664060 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-6929f617-7454-4980-8576-5c41d83a66f8 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012550 Jun 06 20:57:55.664060 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 27/52] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jun 6 20:57:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 20:57:56.532096 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-5fcc442a-fd02-474b-b274-c4bce2ab819e admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:56.533113 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-5fcc442a-fd02-474b-b274-c4bce2ab819e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Jun 06 20:57:56.533513 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 26/53] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 6 20:57:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:57:56.725304 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-96ace09e-2dcd-42f1-b42c-faa6797c4258 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:57:56.745232 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-96ace09e-2dcd-42f1-b42c-faa6797c4258 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.075961 Jun 06 20:57:56.745832 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 28/54] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Jun 6 20:57:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:57:57.628200 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-5fcc442a-fd02-474b-b274-c4bce2ab819e admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:57.629222 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-5fcc442a-fd02-474b-b274-c4bce2ab819e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001654 Jun 06 20:57:57.629613 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 27/55] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 6 20:57:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:57:57.818651 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-a06a2d8e-b273-483f-be7c-3feba3595d07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:57:57.837315 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-a06a2d8e-b273-483f-be7c-3feba3595d07 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.073358 Jun 06 20:57:57.837881 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 29/56] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Jun 6 20:57:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:57:58.702798 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-5fcc442a-fd02-474b-b274-c4bce2ab819e admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:58.703811 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-5fcc442a-fd02-474b-b274-c4bce2ab819e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 06 20:57:58.704220 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 28/57] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 6 20:57:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:57:58.894293 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-f101d2f5-c92c-48ee-a0f9-48ae474372ff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:57:58.913256 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-f101d2f5-c92c-48ee-a0f9-48ae474372ff admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.072507 Jun 06 20:57:58.913736 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 30/58] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Jun 6 20:57:58 2022] POST /compute/v2.1/flavors => generated 407 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 20:57:59.790127 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-5fcc442a-fd02-474b-b274-c4bce2ab819e admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:57:59.791294 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-5fcc442a-fd02-474b-b274-c4bce2ab819e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jun 06 20:57:59.791693 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 29/59] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 6 20:57:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 20:57:59.983673 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-5fd70474-4f78-49dc-9ae4-641efb9e4ef4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 20:58:00.004710 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-5fd70474-4f78-49dc-9ae4-641efb9e4ef4 admin admin] 10.222.0.33 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.080164 Jun 06 20:58:00.005211 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 31/60] 10.222.0.33 () {64 vars in 1235 bytes} [Mon Jun 6 20:57:59 2022] POST /compute/v2.1/flavors => generated 409 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 20:58:01.065317 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-5fcc442a-fd02-474b-b274-c4bce2ab819e admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:58:01.066335 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-5fcc442a-fd02-474b-b274-c4bce2ab819e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jun 06 20:58:01.066736 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 30/61] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 6 20:58:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:58:01.280206 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-6ba3dab4-26b4-47f0-bde9-f0f0ed34e3d6 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:58:01.300961 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-6ba3dab4-26b4-47f0-bde9-f0f0ed34e3d6 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.080691 Jun 06 20:58:01.301526 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 32/62] 10.222.0.33 () {60 vars in 1202 bytes} [Mon Jun 6 20:58:01 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:59:03.010859 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-5fcc442a-fd02-474b-b274-c4bce2ab819e admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:59:03.012285 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-5fcc442a-fd02-474b-b274-c4bce2ab819e admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001866 Jun 06 20:59:03.012769 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 31/63] 10.222.0.33 () {54 vars in 930 bytes} [Mon Jun 6 20:59:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 20:59:03.021431 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:59:03.096850 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-6512e2a7-79ad-4012-9d38-ab5fa97689e6 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:59:03.116800 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-6512e2a7-79ad-4012-9d38-ab5fa97689e6 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.096764 Jun 06 20:59:03.117365 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 33/64] 10.222.0.33 () {60 vars in 1291 bytes} [Mon Jun 6 20:59:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 20:59:03.138482 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG dbcounter [-] [103450] Writing DB stats nova_api:SELECT=14 {{(pid=103450) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 20:59:03.142422 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-bcec98c9-d531-4c9d-8ef5-5e554a876295 admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:59:03.150795 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-bcec98c9-d531-4c9d-8ef5-5e554a876295 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013902 Jun 06 20:59:03.151355 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 32/65] 10.222.0.33 () {60 vars in 1282 bytes} [Mon Jun 6 20:59:03 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:59:03.165018 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-9887bbde-1c97-41a2-b279-80c42b65dc3d admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:59:03.173300 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-9887bbde-1c97-41a2-b279-80c42b65dc3d admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011901 Jun 06 20:59:03.173862 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 34/66] 10.222.0.33 () {60 vars in 1285 bytes} [Mon Jun 6 20:59:03 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:59:03.185831 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-acde90c0-230c-4759-8e2d-c6688abb0f69 admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:59:03.198857 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-acde90c0-230c-4759-8e2d-c6688abb0f69 admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016721 Jun 06 20:59:03.199418 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 33/67] 10.222.0.33 () {60 vars in 1285 bytes} [Mon Jun 6 20:59:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 20:59:03.212694 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-966eb5f8-134d-47b2-a13c-68e30c42b40f admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 20:59:03.221783 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-966eb5f8-134d-47b2-a13c-68e30c42b40f admin admin] 10.222.0.33 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013073 Jun 06 20:59:03.222338 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 35/68] 10.222.0.33 () {60 vars in 1282 bytes} [Mon Jun 6 20:59:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:02:22.558954 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-acde90c0-230c-4759-8e2d-c6688abb0f69 admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:02:22.560185 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-acde90c0-230c-4759-8e2d-c6688abb0f69 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jun 06 21:02:22.560613 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 34/69] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 6 21:02:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:02:22.727528 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writing DB stats nova_api:SELECT=6 {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:02:22.860719 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-84063abe-ec6a-485f-9261-f1b3fc3907cd admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:02:22.861913 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 21:02:22.861913 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: warnings.warn(msg) Jun 06 21:02:22.863118 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-84063abe-ec6a-485f-9261-f1b3fc3907cd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:02:22.863551 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-84063abe-ec6a-485f-9261-f1b3fc3907cd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:02:22.864351 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-84063abe-ec6a-485f-9261-f1b3fc3907cd admin admin] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:02:22.864768 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-84063abe-ec6a-485f-9261-f1b3fc3907cd admin admin] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:02:22.899481 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-84063abe-ec6a-485f-9261-f1b3fc3907cd admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.174600 Jun 06 21:02:22.900211 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jun 6 21:02:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 21:02:23.815710 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-acde90c0-230c-4759-8e2d-c6688abb0f69 admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:02:23.817025 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-acde90c0-230c-4759-8e2d-c6688abb0f69 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001795 Jun 06 21:02:23.817436 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 35/71] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 6 21:02:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:02:24.027193 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-c988c96b-3dfa-44fb-baaa-02dcfd860d24 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:02:24.028463 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 21:02:24.028463 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: warnings.warn(msg) Jun 06 21:02:24.029701 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-c988c96b-3dfa-44fb-baaa-02dcfd860d24 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:02:24.030143 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-c988c96b-3dfa-44fb-baaa-02dcfd860d24 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:02:24.031000 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-c988c96b-3dfa-44fb-baaa-02dcfd860d24 admin admin] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:02:24.031429 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-c988c96b-3dfa-44fb-baaa-02dcfd860d24 admin admin] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:02:24.052526 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-c988c96b-3dfa-44fb-baaa-02dcfd860d24 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.082003 Jun 06 21:02:24.053114 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 37/72] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jun 6 21:02:23 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 21:02:35.385955 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-acde90c0-230c-4759-8e2d-c6688abb0f69 admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:02:35.386966 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-acde90c0-230c-4759-8e2d-c6688abb0f69 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jun 06 21:02:35.387403 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 36/73] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 6 21:02:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:02:35.532202 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writing DB stats nova_cell0:SELECT=4 {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:02:35.532899 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writing DB stats nova_cell1:SELECT=4 {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:02:35.533546 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG dbcounter [-] [103449] Writing DB stats nova_api:SELECT=8 {{(pid=103449) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:02:35.590448 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-17a9454d-eca8-4879-ae36-3808145a03b4 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:02:35.591638 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 21:02:35.591638 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: warnings.warn(msg) Jun 06 21:02:35.592957 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-17a9454d-eca8-4879-ae36-3808145a03b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:02:35.593393 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-17a9454d-eca8-4879-ae36-3808145a03b4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:02:35.594111 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-17a9454d-eca8-4879-ae36-3808145a03b4 admin admin] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:02:35.594560 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-17a9454d-eca8-4879-ae36-3808145a03b4 admin admin] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:02:35.620609 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-17a9454d-eca8-4879-ae36-3808145a03b4 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.092771 Jun 06 21:02:35.621183 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 38/74] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jun 6 21:02:35 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:02:36.509841 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: DEBUG nova.api.openstack.wsgi [None req-acde90c0-230c-4759-8e2d-c6688abb0f69 admin admin] Calling method '>' {{(pid=103450) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:02:36.511050 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: INFO nova.api.openstack.requestlog [None req-acde90c0-230c-4759-8e2d-c6688abb0f69 admin admin] 10.222.0.33 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jun 06 21:02:36.511451 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: [pid: 103450|app: 0|req: 37/75] 10.222.0.33 () {56 vars in 1074 bytes} [Mon Jun 6 21:02:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:02:36.713232 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG nova.api.openstack.wsgi [None req-b73ba4e6-2093-44b1-abe3-b09347900354 admin admin] Calling method '>' {{(pid=103449) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:02:36.715256 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 21:02:36.715256 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: warnings.warn(msg) Jun 06 21:02:36.716709 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-b73ba4e6-2093-44b1-abe3-b09347900354 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:02:36.717085 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-b73ba4e6-2093-44b1-abe3-b09347900354 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:02:36.717886 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-b73ba4e6-2093-44b1-abe3-b09347900354 admin admin] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:02:36.718322 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: DEBUG oslo_concurrency.lockutils [None req-b73ba4e6-2093-44b1-abe3-b09347900354 admin admin] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103449) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:02:36.741913 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: INFO nova.api.openstack.requestlog [None req-b73ba4e6-2093-44b1-abe3-b09347900354 admin admin] 10.222.0.33 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.085730 Jun 06 21:02:36.742508 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: [pid: 103449|app: 0|req: 39/76] 10.222.0.33 () {60 vars in 1193 bytes} [Mon Jun 6 21:02:36 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:03:37.309385 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: Mon Jun 6 21:03:37 2022 - graceful shutdown triggered... Jun 06 21:03:37.309441 dv-cinder-844880-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 06 21:03:37.310442 dv-cinder-844880-1-iscsi devstack@n-api.service[103449]: Gracefully killing worker 1 (pid: 103449)... Jun 06 21:03:37.310901 dv-cinder-844880-1-iscsi devstack@n-api.service[103450]: Gracefully killing worker 2 (pid: 103450)... Jun 06 21:03:38.310638 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: worker 1 buried after 1 seconds Jun 06 21:03:38.310638 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: worker 2 buried after 1 seconds Jun 06 21:03:38.310638 dv-cinder-844880-1-iscsi devstack@n-api.service[103448]: goodbye to uWSGI. Jun 06 21:03:38.312278 dv-cinder-844880-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 06 21:03:38.312862 dv-cinder-844880-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 06 21:03:38.315592 dv-cinder-844880-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 06 21:03:38.328647 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 06 21:03:38.348480 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 6 21:03:38 2022] *** Jun 06 21:03:38.348480 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 06 21:03:38.348480 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 06 21:03:38.348480 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: nodename: dv-cinder-844880-1-iscsi Jun 06 21:03:38.348480 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: machine: x86_64 Jun 06 21:03:38.348480 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: clock source: unix Jun 06 21:03:38.348480 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: pcre jit disabled Jun 06 21:03:38.348480 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: detected number of CPU cores: 4 Jun 06 21:03:38.348480 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: current working directory: / Jun 06 21:03:38.348480 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: detected binary path: /usr/bin/uwsgi-core Jun 06 21:03:38.348480 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: your processes number limit is 47680 Jun 06 21:03:38.348480 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: your memory page size is 4096 bytes Jun 06 21:03:38.348480 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: detected max file descriptor number: 2048 Jun 06 21:03:38.348480 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: lock engine: pthread robust mutexes Jun 06 21:03:38.349801 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: thunder lock: enabled Jun 06 21:03:38.349801 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 06 21:03:38.349801 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 06 21:03:38.395057 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: Python main interpreter initialized at 0x559ce2b999c0 Jun 06 21:03:38.395057 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: python threads support enabled Jun 06 21:03:38.395057 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: your server socket listen backlog is limited to 100 connections Jun 06 21:03:38.395057 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: your mercy for graceful operations on workers is 90 seconds Jun 06 21:03:38.395550 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: mapped 403077 bytes (393 KB) for 2 cores Jun 06 21:03:38.395550 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: *** Operational MODE: preforking *** Jun 06 21:03:38.395779 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: *** uWSGI is running in multiple interpreter mode *** Jun 06 21:03:38.395779 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: spawned uWSGI master process (pid: 117841) Jun 06 21:03:38.395982 dv-cinder-844880-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 06 21:03:38.396641 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: spawned uWSGI worker 1 (pid: 117859, cores: 1) Jun 06 21:03:38.397003 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: spawned uWSGI worker 2 (pid: 117860, cores: 1) Jun 06 21:03:38.397141 dv-cinder-844880-1-iscsi devstack@n-api.service[117841]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 06 21:03:39.630654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 21:03:39.632607 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 21:03:40.454716 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 21:03:40.454716 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: from cryptography.utils import int_from_bytes Jun 06 21:03:40.455160 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 21:03:40.455160 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: from cryptography.utils import int_from_bytes Jun 06 21:03:40.456365 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 21:03:40.456365 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: from cryptography.utils import int_from_bytes Jun 06 21:03:40.456683 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 21:03:40.456683 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: from cryptography.utils import int_from_bytes Jun 06 21:03:42.828178 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 21:03:42.828744 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 21:03:42.829076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 21:03:42.829379 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 21:03:42.829679 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 21:03:42.830145 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.830512 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 21:03:42.831244 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.831329 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 21:03:42.831424 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.831645 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.831741 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 21:03:42.831845 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.832031 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 21:03:42.832200 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.832303 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 21:03:42.832493 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.832668 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.832837 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.832993 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.833172 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.833364 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.833474 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.833654 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.833749 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.833961 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.834115 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844880-1-iscsi {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.834351 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.834493 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.834639 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.834784 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.834933 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.835081 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.835229 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.835387 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.835526 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.835715 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.835859 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.836038 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.836218 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.836386 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844880-1-iscsi {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.836386 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.836683 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.836844 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.837079 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.837338 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.837639 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.837965 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.838273 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.838495 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.838779 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.839016 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.839175 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.839507 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.839669 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.839871 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.840042 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.840201 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.840505 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.840765 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.840992 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.841197 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.841425 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.841638 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.841866 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.842064 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.842281 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.842478 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.842677 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.842861 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.843059 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844880-1-iscsi {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.843227 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844880-1-iscsi {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.843409 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.843552 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.843552 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.843892 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.844090 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.844235 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.844384 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.844579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.844747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.844994 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.845204 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.845350 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.845538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.845678 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.845847 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.846019 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.846019 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.846303 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.846450 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.846598 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.846755 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.846910 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.847069 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.847377 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.847646 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.848158 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.848332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.850090 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.850265 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.850409 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.850555 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.850707 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.850846 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.851002 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.851002 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.851294 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.851433 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.851570 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.851713 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.852131 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.852289 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.852429 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.852567 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.852711 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.852868 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.853108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.853265 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.853466 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.853623 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.853775 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.853916 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.854063 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.854227 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.854375 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.854514 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.854663 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.854810 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.854970 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.855111 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.855250 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.855401 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.855549 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.855688 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.855826 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.856026 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.856183 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.856334 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.856473 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.856618 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.856773 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.856931 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.857077 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.857077 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.857377 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.857624 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.857873 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.858232 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.858474 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.858650 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.859033 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.859201 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.859361 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.859509 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.859676 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.33 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.859830 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.859977 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.33 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.860356 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.860542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.860542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.860820 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.860820 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.861104 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.861104 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.861382 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.861382 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.861722 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.861863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.862030 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.862288 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.862433 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.862572 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.862726 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.862872 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.863018 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.863168 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.863331 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.863562 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.863717 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.863870 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.864104 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.864262 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.864418 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.864571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.864721 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.864860 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.864997 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.865133 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.865278 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.865278 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.865551 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.865551 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.865823 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.865969 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.866142 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.866299 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.866440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.866593 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.866593 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.866876 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.867014 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.867237 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.867378 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.867516 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.867516 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.868018 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.868349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.868521 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.868755 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.868918 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.869152 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.869296 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.869456 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.869630 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.869775 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.869915 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.870053 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.870192 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.870464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.870608 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.870747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.870886 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.871025 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.871169 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.871331 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.871478 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.871627 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.871773 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.871911 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.875031 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.875246 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.875399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.875553 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.875704 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.875845 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.876079 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.876246 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.876397 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.876539 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.876695 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.876839 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.877151 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.877315 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.877480 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.877620 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.877904 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.878160 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.878520 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.878693 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.879134 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.879379 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.879523 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.879661 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.879875 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.880106 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.880252 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.880459 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.880725 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.880725 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.881016 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.881164 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.881311 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.881452 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.881589 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.881726 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.881884 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.882032 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.882172 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.882310 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.882468 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.882679 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.882833 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.882973 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.883112 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.883258 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.883406 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.883567 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.883715 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.883855 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.884033 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.884179 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.884319 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.884481 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.884622 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 21:03:42.884760 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.884916 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.885886 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.886041 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.886197 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.886337 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.886474 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.886474 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.886764 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.886924 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.887082 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.887230 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.887384 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.887539 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.887687 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.887840 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.888166 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.888410 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.888706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.888851 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.889017 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.889245 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.889426 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.889648 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.889806 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.889806 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.890088 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.890235 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.890383 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.890532 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.890670 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.890904 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.891049 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.891196 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.891354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.891506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.891768 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.891916 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.892088 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.892240 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.892379 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.892525 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.892664 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.892809 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.892957 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.893114 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.893253 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.893399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.893559 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.893720 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.893905 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.894063 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.894356 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.894510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.894658 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.894805 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.894953 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.895093 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.895237 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.895404 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.895625 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.896099 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.896335 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.896764 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.896970 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.897165 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.897359 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.897564 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.897773 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.897975 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.898297 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.898554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.899000 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.899257 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.899702 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.900115 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.900350 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.900581 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.900790 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.901061 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.901298 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.901453 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.901594 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.901740 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.901886 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.902039 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.902192 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.902341 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.902488 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.902665 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.902898 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.903102 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.903303 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.903542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.903770 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.903925 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.904102 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.904260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.904516 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.904687 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.904829 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.904975 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.905114 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.905266 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.905413 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.905555 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.905702 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.905840 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.905992 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.905992 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.906537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.906724 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.906885 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.907025 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.907173 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.907421 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.907645 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.907847 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.908085 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.908317 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.908687 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.909227 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.909458 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.909860 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.910459 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.910758 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.910929 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.911266 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.911428 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.911569 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.911716 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.911868 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.912059 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.912253 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.912405 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.912545 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.912683 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.912886 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.913038 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.913186 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.913357 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.913500 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.913638 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.913786 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.913965 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.914116 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.914256 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.914401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.914638 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.914843 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.915035 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.915188 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.915328 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.915501 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.915650 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.915790 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.915967 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.916175 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.916175 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.916698 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.916861 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.917050 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.917213 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.917213 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.917213 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.917647 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.917795 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.917795 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.918133 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.918277 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.918416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.918554 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.918801 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.918947 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.919110 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.919414 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.919414 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.919732 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.919975 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.920268 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.920496 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.920658 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.920805 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.920961 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.921100 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.921268 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.921521 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.921705 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.921874 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.922029 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.922168 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.922362 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.922514 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.922653 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.922792 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.923009 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.923151 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.923297 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.923444 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.923583 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.923734 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.923884 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.924052 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.924206 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.924401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.924545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.924545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.925029 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.925262 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.925472 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.925472 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.925929 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.926150 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.926350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.926636 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.927090 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.927290 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.927487 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.927706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.927920 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.928497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.928722 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.929029 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.929338 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.929655 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.929851 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.930103 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.930251 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.930405 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.930713 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.930861 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.931009 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.931148 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.931304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.931304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.931735 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.931934 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.932167 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.932361 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.932612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.932760 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.932910 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.933057 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.933197 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.933342 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.933480 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.933625 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.933805 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.933982 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.934132 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.934271 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.934419 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.934588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.934789 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.935081 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.935287 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.935479 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.935680 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.935908 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.936091 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.936234 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.936373 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.936519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.936690 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.936945 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.937339 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.937481 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.937621 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.937768 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.937951 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.938106 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.938303 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.938540 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.938736 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.938999 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.939288 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.939448 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.939605 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.939922 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.940379 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.940529 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.940803 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.940952 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.941092 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.941234 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.941372 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.941510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.941681 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.941901 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.942053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.942217 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.942368 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.942515 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.942669 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.942809 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.943005 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.943153 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.943293 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.943439 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.943592 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.943732 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.943879 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.944035 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.944200 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.944355 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.944503 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.944642 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.944781 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.944919 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.945079 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.945303 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.945448 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.945602 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.945750 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.945888 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.946068 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.946235 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.946392 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.946536 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.946681 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.946829 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.946968 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.947119 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.947464 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.947611 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.947751 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.947888 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.948159 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.948314 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.948473 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.948621 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.948802 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.948946 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.949095 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.949253 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.949465 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.949613 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.949770 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.950065 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.950226 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.950392 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.950610 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.950791 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.951052 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.951809 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.952064 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.952223 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.952374 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.952514 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.952658 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.952800 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.952949 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.953342 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.953548 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.953785 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.953945 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.954178 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.954327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.954474 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.954624 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.954765 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.954903 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.955042 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.955188 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.955446 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.955933 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.956114 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.956274 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.956425 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.956573 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.956727 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.956901 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.957054 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.957202 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.957349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.957742 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.957899 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.958042 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.958200 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.958355 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.958503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.958645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.958816 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.959135 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.959305 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.959305 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.959699 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.959860 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.960522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.960813 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.961059 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.961323 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.961468 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.961619 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.961759 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.961901 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.962059 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.962059 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.962466 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.962617 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.962766 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.962766 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.963030 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.963180 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.963341 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.963489 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.963638 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.963777 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.963969 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.964145 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.964288 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.964434 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.964580 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.964727 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.964913 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.965074 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.965233 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.965390 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.965894 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.966037 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.966185 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.966327 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.966465 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.966614 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.966753 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.966899 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.967039 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.967220 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.967364 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.967525 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.967691 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.967864 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.968091 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.968494 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.968645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.968802 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.968952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.968952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.969226 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.969374 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.969525 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.969719 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.969965 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.970119 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.970470 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.970618 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.970996 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.971145 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.971304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.971541 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.971688 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.971835 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.972007 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.972007 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.972293 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.972548 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.972701 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.972864 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.973049 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.973194 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.973342 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.973498 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.973646 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.973802 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.973941 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.974079 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.974225 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.974225 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.974509 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.974662 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.974803 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.974949 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.975088 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.975275 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.975428 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.975591 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.975746 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.976054 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.976210 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.976356 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.976529 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.976529 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.976816 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.976816 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.977110 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.977262 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.977423 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.977577 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.977722 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.977867 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.978020 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.978165 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.978390 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.978655 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.978817 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.979118 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.979284 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.979432 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.979588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.979735 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.979879 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.980117 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.980271 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.980574 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.980737 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.980900 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.981135 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.981297 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.981445 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.981693 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.981847 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.981995 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.982141 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.982286 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.982439 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.982679 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.982839 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.982987 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.983145 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.983298 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.983444 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.983604 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.983751 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.983896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.984111 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.984267 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.984422 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.984568 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.984721 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.984868 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.985021 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.985182 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.985408 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.985576 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.985722 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.985880 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.986110 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.986272 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.986430 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.986625 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.986781 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.986936 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.987081 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.987224 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.987390 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.987538 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.987698 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.987853 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.988015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.988178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.988327 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.988471 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.988639 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.988877 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.989073 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.989234 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.989383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.989547 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.989703 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.989848 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.989992 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.990251 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.990517 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.990813 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.990990 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.991417 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.991584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.991834 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.992015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.992172 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.992329 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.992486 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.992687 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.992922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.993083 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.993229 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.993374 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.993527 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.993685 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.993685 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.993685 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.993685 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.993685 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.994438 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.994593 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.994740 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.994885 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.995037 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.995191 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.995336 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.995491 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.995644 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.995798 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.995954 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.996136 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.996391 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.996542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.996694 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.996850 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.997002 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.997156 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.997309 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.997463 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.997463 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.997750 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.997907 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.998068 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.998224 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.998408 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.998674 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.998833 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.999099 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.999260 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.999417 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.999573 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.999727 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:42.999882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.000069 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.000233 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.000397 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.000793 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.001006 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.001161 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.001307 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.001565 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.001719 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.001969 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.002124 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.002270 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.002415 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.002605 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.002756 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.002918 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.003154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.003317 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.003477 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.003636 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.003792 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.003938 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.004110 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.004268 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.004414 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.004569 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.004716 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.004862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.005007 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.005196 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.005360 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.005506 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.005664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.005821 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.005976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.006122 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.006282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.006510 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.006664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.006818 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.006964 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.007117 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.007293 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.007482 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.007642 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.007789 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.007943 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.007943 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.008294 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.008294 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.008589 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.008737 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.008881 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.009045 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.009290 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.009455 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.009611 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.009756 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.009901 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.010133 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.010288 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.010436 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.010585 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.010930 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.011092 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.011092 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.011394 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.011394 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.011786 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.011966 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.012145 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.012307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.012463 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.012609 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.012755 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.012922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.013078 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.013309 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.013460 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.013607 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.013772 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.013926 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.014088 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.014244 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.014391 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.014538 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.014692 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.014838 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.014993 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.014993 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.015270 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.015415 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.015568 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.015728 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.015882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.016062 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.016215 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.016362 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.016527 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.016814 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.016977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.017125 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.017271 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.017417 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.017561 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.017733 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.017889 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.018044 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.018197 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.018344 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.018488 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.018678 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.018837 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.019001 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.019160 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.019337 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.019586 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.019739 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.019897 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.020077 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.020230 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.020389 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.020537 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.020683 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.020935 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.021094 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.021272 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.021433 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.021581 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.021737 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.021976 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.022138 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.022294 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.022448 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.022594 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.022739 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.022892 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.023049 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.023205 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.023446 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.023642 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.023789 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.023934 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.024114 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.024288 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.024444 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.024600 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.024756 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.024902 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.025055 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.025212 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.025366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.025533 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.025683 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.025837 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.025997 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.026170 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.026354 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.026510 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.026656 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.026826 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.027051 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.027215 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.027372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.027517 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.027662 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.027815 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.027972 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.028143 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.028303 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.028461 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.028607 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.028753 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.028911 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.029057 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.029210 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.029367 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.029541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.029804 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.029966 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.030114 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.030261 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.030420 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.030566 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.030720 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.030876 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.030876 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.031238 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.031387 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.031541 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.031541 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.031839 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.032061 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.032275 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.032511 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.032764 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.033121 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.033368 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.033744 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.034003 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.034259 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.034546 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.036143 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.036274 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.036353 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.036424 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.036503 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.036586 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.036658 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.036735 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.036806 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.036912 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.037055 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.037154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.037227 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.037296 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.037366 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.037443 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.037522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.037603 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.037681 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.037758 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.037835 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.037946 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.038059 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.038143 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.038215 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.038284 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.038360 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.038431 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.038509 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.038581 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.038581 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.038714 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.038784 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.038874 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.038960 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.039055 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.039125 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.039201 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.039273 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.039348 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.039429 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.039508 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.039579 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.039648 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.039725 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.039803 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.039874 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.039950 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.040257 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.040375 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.040448 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.040538 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.040612 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.040680 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.040748 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.040824 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.040903 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.040981 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.041108 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.041198 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.041268 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.041336 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.041405 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.041484 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.041563 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.041633 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.041712 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.041784 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.041861 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.041932 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.042009 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.042079 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.042157 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.042255 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.042369 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.042458 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.042539 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.042618 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.042689 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.042775 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.042855 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.042963 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.043049 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.043128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.043199 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.043267 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.043345 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.043416 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.043493 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.043563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.043633 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.043715 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.043810 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.043884 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.043961 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.044051 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.044122 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.044205 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.044284 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.044354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.044431 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.044524 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.044596 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.044674 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.044752 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.044823 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.044900 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.044979 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.045067 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.045147 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.045218 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.045288 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.045356 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.045425 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.045502 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.045573 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.045642 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.045719 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.045803 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.045877 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.045955 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.046026 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.046102 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.046173 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.046248 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.046333 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.046406 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.046475 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.046544 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.046621 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.046700 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.046771 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.046849 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.046925 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.046996 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.047065 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.047146 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.047218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.047295 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.047366 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.047435 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.047511 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.047595 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.047666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.047743 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.047820 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.047980 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.048079 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.048168 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.048247 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.048326 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.048411 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.048483 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.048572 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.048712 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.049391 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.049466 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.049545 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.049617 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.049699 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.049778 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.049850 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.049926 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.050004 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.050075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.050158 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.050237 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.050315 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.050393 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.050464 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.050542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.050613 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.050690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.050760 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.050829 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.050898 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.051060 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.051134 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.051211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.051294 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.051371 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.051441 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.051518 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.051596 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.051667 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.051736 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.051865 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.052008 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.052145 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.052254 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.052362 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.052468 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.052579 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.052700 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.052816 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.052923 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.053036 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.053185 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.053310 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.053436 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.053545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.053653 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.054296 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.054389 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.054488 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.054575 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.054665 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.054749 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.054839 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.054923 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.055018 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.055108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.055247 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.055347 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.055440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.055533 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.055625 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.055708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.055789 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.055872 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.055953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.056101 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.056190 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.056272 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.056362 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.056453 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.056543 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.056635 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.056725 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.056809 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.056892 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.056892 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.057064 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.057161 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.057251 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.057342 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.057433 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.057518 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.057610 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.057702 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.057702 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.057858 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.057948 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.058038 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.058131 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.058131 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.058298 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.058381 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.058463 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.058553 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.058646 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.058730 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.058730 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.058933 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.059103 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.059415 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.059557 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.059647 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.059737 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.059821 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.059911 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.060019 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.060118 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.060202 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.060292 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.060381 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.060471 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.060569 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.060660 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.060750 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.060833 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.060922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.061006 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.061101 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.061191 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.061282 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.061372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.061462 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.061553 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.061646 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.061730 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.061811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.061893 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.062014 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.062143 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.062241 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.062333 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.062416 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.062416 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.062575 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.062667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.062751 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.062832 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.062921 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.063012 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.063104 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.063104 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.063283 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.063380 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.063486 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.063619 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.063768 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.064122 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.064278 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.064391 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.064499 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.064605 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.064716 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.064810 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.064895 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.064978 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.065068 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.065152 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.065249 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.065381 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.065472 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.065563 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.065655 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.065746 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.065842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.065928 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.066011 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.066100 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.066184 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.066275 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.066367 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.066459 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.066542 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.066634 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.066734 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.066872 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.066970 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.067062 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.067153 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.067245 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.067335 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.067429 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.067512 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.067602 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.067685 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.067767 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.067866 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.067950 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.068050 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.068146 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.068231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.068325 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.068418 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.068501 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.068592 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.068675 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.068757 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.068839 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.068930 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.069015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.069104 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.069234 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.069384 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.069581 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.069755 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.069849 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.069933 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.070029 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.070114 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.070211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.070304 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.070387 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.070469 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.070557 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.070648 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.070734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.070817 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.070907 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.070997 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.071080 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.071163 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.071254 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.071344 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.071436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.071519 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.071608 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.071746 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.071834 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.071834 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.071985 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.072164 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.072251 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.072348 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.072432 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.072522 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.072605 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.072694 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.072776 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.072876 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.072968 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.073066 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.073158 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.073249 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.073340 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.073424 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.073507 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.073588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.073669 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.073758 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.073854 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.073937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.074019 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.074107 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.074197 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.074280 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.074374 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.074457 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.074538 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.074667 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.074792 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.074877 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.074970 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.075061 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.075144 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.075233 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.075316 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.075410 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.075482 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.075551 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.075632 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.075713 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.075808 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.075905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.076017 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.076093 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.076162 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.076243 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.076314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.076392 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.076472 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.076542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.076611 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.076679 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.076748 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.076825 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.076895 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.076971 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.077041 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.077117 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.077196 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.077266 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.077343 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.077413 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.077496 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.077587 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.077683 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.077771 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.077853 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.077943 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.078033 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.078116 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.078260 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.078355 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.078438 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.078528 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.078611 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.078702 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.078795 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.078886 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.078969 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.079059 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.079222 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.079345 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.079461 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.079562 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.079649 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.079727 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.079806 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.079889 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.079974 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.080095 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.080177 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.080272 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.080356 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.080451 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.080878 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.080976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.081060 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.081142 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.081142 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.081309 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.081399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.081482 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.081565 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.081648 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.081743 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.081833 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.081916 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.081997 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.082088 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.082178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.082259 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.082331 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.082412 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.082501 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.082584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.082673 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.082763 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.082763 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.082914 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.083095 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.083215 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.083404 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.083507 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.083714 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.083817 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.084043 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.084149 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.084360 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.084460 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.084678 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.084809 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.084995 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.085100 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.085323 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.085423 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.085649 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.085739 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.085960 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.086060 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.086270 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.086365 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.086577 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.086667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.086821 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117859) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 21:03:43.086921 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.087237 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.087581 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.087912 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.088258 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.088574 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.088884 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 21:03:43.089128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117860) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 21:03:43.146944 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO dbcounter [None req-d09bb748-ad7e-4bb4-ac1e-316a46a4f735 None None] Registered counter for database nova_api Jun 06 21:03:43.149162 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO dbcounter [None req-49e78009-bfa0-4cde-859e-71468101d5ce None None] Registered counter for database nova_api Jun 06 21:03:43.167816 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_db.sqlalchemy.engines [None req-d09bb748-ad7e-4bb4-ac1e-316a46a4f735 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117859) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 21:03:43.169418 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_db.sqlalchemy.engines [None req-49e78009-bfa0-4cde-859e-71468101d5ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117860) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 21:03:43.174823 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writer thread running {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 21:03:43.176800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writer thread running {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 21:03:43.231585 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.context [None req-d09bb748-ad7e-4bb4-ac1e-316a46a4f735 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8aa9ac8e-66e4-43b2-82e7-ace0654f5925(cell1) {{(pid=117859) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 21:03:43.235816 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d09bb748-ad7e-4bb4-ac1e-316a46a4f735 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:03:43.236291 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.context [None req-49e78009-bfa0-4cde-859e-71468101d5ce None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8aa9ac8e-66e4-43b2-82e7-ace0654f5925(cell1) {{(pid=117860) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 21:03:43.237584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d09bb748-ad7e-4bb4-ac1e-316a46a4f735 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:03:43.238412 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d09bb748-ad7e-4bb4-ac1e-316a46a4f735 None None] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:03:43.240445 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d09bb748-ad7e-4bb4-ac1e-316a46a4f735 None None] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:03:43.240585 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-49e78009-bfa0-4cde-859e-71468101d5ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:03:43.242016 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-49e78009-bfa0-4cde-859e-71468101d5ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:03:43.242485 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO dbcounter [None req-d09bb748-ad7e-4bb4-ac1e-316a46a4f735 None None] Registered counter for database nova_cell0 Jun 06 21:03:43.242817 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-49e78009-bfa0-4cde-859e-71468101d5ce None None] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:03:43.245032 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-49e78009-bfa0-4cde-859e-71468101d5ce None None] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:03:43.248096 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO dbcounter [None req-d09bb748-ad7e-4bb4-ac1e-316a46a4f735 None None] Registered counter for database nova_cell1 Jun 06 21:03:43.248403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO dbcounter [None req-49e78009-bfa0-4cde-859e-71468101d5ce None None] Registered counter for database nova_cell0 Jun 06 21:03:43.256441 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_db.sqlalchemy.engines [None req-d09bb748-ad7e-4bb4-ac1e-316a46a4f735 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117859) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 21:03:43.256925 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO dbcounter [None req-49e78009-bfa0-4cde-859e-71468101d5ce None None] Registered counter for database nova_cell1 Jun 06 21:03:43.258007 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_db.sqlalchemy.engines [None req-d09bb748-ad7e-4bb4-ac1e-316a46a4f735 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117859) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 21:03:43.265289 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writer thread running {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 21:03:43.267615 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_db.sqlalchemy.engines [None req-49e78009-bfa0-4cde-859e-71468101d5ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117860) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 21:03:43.268930 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_db.sqlalchemy.engines [None req-49e78009-bfa0-4cde-859e-71468101d5ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117860) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 21:03:43.270829 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writer thread running {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 21:03:43.276265 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writer thread running {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 21:03:43.277567 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writer thread running {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 21:03:43.415198 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO dbcounter [None req-d09bb748-ad7e-4bb4-ac1e-316a46a4f735 None None] Registered counter for database nova_cell0 Jun 06 21:03:43.422594 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_db.sqlalchemy.engines [None req-d09bb748-ad7e-4bb4-ac1e-316a46a4f735 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117859) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 21:03:43.426454 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO dbcounter [None req-49e78009-bfa0-4cde-859e-71468101d5ce None None] Registered counter for database nova_cell0 Jun 06 21:03:43.428218 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writer thread running {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 21:03:43.435459 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_db.sqlalchemy.engines [None req-49e78009-bfa0-4cde-859e-71468101d5ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117860) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 21:03:43.440285 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writer thread running {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 21:03:43.875542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: WARNING keystonemiddleware.auth_token [None req-d09bb748-ad7e-4bb4-ac1e-316a46a4f735 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 21:03:43.883605 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: WARNING keystonemiddleware.auth_token [None req-49e78009-bfa0-4cde-859e-71468101d5ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 21:03:43.884116 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: WARNING keystonemiddleware.auth_token [None req-d09bb748-ad7e-4bb4-ac1e-316a46a4f735 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 21:03:43.892517 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: WARNING keystonemiddleware.auth_token [None req-49e78009-bfa0-4cde-859e-71468101d5ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 21:03:44.110919 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: WARNING keystonemiddleware.auth_token [None req-d09bb748-ad7e-4bb4-ac1e-316a46a4f735 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 21:03:44.116517 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: WARNING keystonemiddleware.auth_token [None req-49e78009-bfa0-4cde-859e-71468101d5ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 21:03:44.117129 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: WARNING keystonemiddleware.auth_token [None req-d09bb748-ad7e-4bb4-ac1e-316a46a4f735 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 21:03:44.122433 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559ce2b999c0 pid: 117859 (default app) Jun 06 21:03:44.122673 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: WARNING keystonemiddleware.auth_token [None req-49e78009-bfa0-4cde-859e-71468101d5ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 21:03:44.128134 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559ce2b999c0 pid: 117860 (default app) Jun 06 21:04:26.553409 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:26.555782 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:26.558190 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:26.561196 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:27.438996 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4edb2f04-28a1-4441-87ab-dce0d85fd241 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] Action: 'create', calling method: .version_select at 0x7f2727f085e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1170119170", "metadata": {"Type": "work"}}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:04:27.462166 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4edb2f04-28a1-4441-87ab-dce0d85fd241 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] Request method failure captured: Jun 06 21:04:27.462166 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 06 21:04:27.462166 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:04:27.462166 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:04:27.462166 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:04:27.462166 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 122 Jun 06 21:04:27.462166 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:04:27.462166 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:04:27.462166 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:04:27.462166 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:04:27.462166 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinmvao5LKSkcQTGGgD27188MrWjEWRbMM9PkgYLQu84pHUnPUGQdVcWEWjszpel8Yf5iNBde0_aNNZ9KyUmsL394W_JrcpfhLH8oHV-hebHopfwgaQQoNWSbB2-iYkGkX9v0HaVMZzVijkGA-VwnXrtfAoMHfhSBss0xs3DedOmjT7Ak Jun 06 21:04:27.462166 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:04:27.462166 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:04:27.462166 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:04:27.462166 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:04:27.462166 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:04:27.462166 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:04:27.462166 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 84a495ebc66440419f2475ab298ef29a Jun 06 21:04:27.462166 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesNegativeTest-102567390 Jun 06 21:04:27.462166 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:04:27.462166 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:04:27.463684 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/84a495ebc66440419f2475ab298ef29a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_84a495ebc66440419f2475ab298ef29a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/84a495ebc66440419f2475ab298ef29a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/84a495ebc66440419f2475ab298ef29a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:04:27.463684 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesNegativeTest-102567390 Jun 06 21:04:27.463684 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 84a495ebc66440419f2475ab298ef29a Jun 06 21:04:27.463684 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesNegativeTest-102567390 Jun 06 21:04:27.463684 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesNegativeTest-102567390-project Jun 06 21:04:27.463684 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:04:27.463684 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:04:27.463684 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: e1ce45ce4783427e8ee91607e9fcc7a3 Jun 06 21:04:27.463684 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesNegativeTest-102567390-project Jun 06 21:04:27.463684 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Jun 06 21:04:27.463684 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1170119170", "metadata": {"Type": "work"}}} Jun 06 21:04:27.463684 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: Jun 06 21:04:27.463684 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 06 21:04:27.464609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1170119170', 'metadata': {'Type': 'work'}}}} Jun 06 21:04:27.464609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:04:27.464609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:27.464609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 06 21:04:27.464609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 06 21:04:27.464609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 06 21:04:27.464609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise error Jun 06 21:04:27.464609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 06 21:04:27.464609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:04:27.464609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 06 21:04:27.464609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 06 21:04:27.464609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:04:27.464609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 06 21:04:27.464609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi '#$%' Jun 06 21:04:27.464609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:04:27.464609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:04:27.464609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:04:27.464609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:27.464609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:04:27.464609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:04:27.464609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:04:27.464609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:04:27.467250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 21:04:27.467250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 21:04:27.467250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:04:27.467250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:04:27.467250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 06 21:04:27.467250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 06 21:04:27.467250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 06 21:04:27.467250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 06 21:04:27.467250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 06 21:04:27.467250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 06 21:04:27.467250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 06 21:04:27.467250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:04:27.467250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:04:27.467250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:04:27.467250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:27.467250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:04:27.467250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:04:27.467250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 06 21:04:27.467250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 06 21:04:27.468544 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 06 21:04:27.468544 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:04:27.468544 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4edb2f04-28a1-4441-87ab-dce0d85fd241 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:04:27.468544 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4edb2f04-28a1-4441-87ab-dce0d85fd241 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.921273 Jun 06 21:04:27.468544 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 1/1] 10.222.0.33 () {60 vars in 1155 bytes} [Mon Jun 6 21:04:26 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 924 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 06 21:04:27.730475 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b371c734-1344-4c9a-ad98-e031462308d7 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] Action: 'create', calling method: .version_select at 0x7f2728185790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-773324844", "metadata": {"Type": "work"}}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:04:27.735401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b371c734-1344-4c9a-ad98-e031462308d7 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] Request method failure captured: Jun 06 21:04:27.735401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 06 21:04:27.735401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:04:27.735401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:04:27.735401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:04:27.735401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 119 Jun 06 21:04:27.735401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:04:27.735401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:04:27.735401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:04:27.735401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:04:27.735401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinmvao5LKSkcQTGGgD27188MrWjEWRbMM9PkgYLQu84pHUnPUGQdVcWEWjszpel8Yf5iNBde0_aNNZ9KyUmsL394W_JrcpfhLH8oHV-hebHopfwgaQQoNWSbB2-iYkGkX9v0HaVMZzVijkGA-VwnXrtfAoMHfhSBss0xs3DedOmjT7Ak Jun 06 21:04:27.735401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:04:27.735401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:04:27.735401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:04:27.735401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:04:27.735401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:04:27.735401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:04:27.735401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: 84a495ebc66440419f2475ab298ef29a Jun 06 21:04:27.735401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-VolumesNegativeTest-102567390 Jun 06 21:04:27.735401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:04:27.735401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:04:27.736849 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/84a495ebc66440419f2475ab298ef29a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_84a495ebc66440419f2475ab298ef29a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/84a495ebc66440419f2475ab298ef29a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/84a495ebc66440419f2475ab298ef29a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:04:27.736849 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-VolumesNegativeTest-102567390 Jun 06 21:04:27.736849 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: 84a495ebc66440419f2475ab298ef29a Jun 06 21:04:27.736849 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-VolumesNegativeTest-102567390 Jun 06 21:04:27.736849 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-VolumesNegativeTest-102567390-project Jun 06 21:04:27.736849 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:04:27.736849 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:04:27.736849 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: e1ce45ce4783427e8ee91607e9fcc7a3 Jun 06 21:04:27.736849 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-VolumesNegativeTest-102567390-project Jun 06 21:04:27.736849 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Jun 06 21:04:27.736849 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-773324844", "metadata": {"Type": "work"}}} Jun 06 21:04:27.736849 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: Jun 06 21:04:27.736849 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 06 21:04:27.737645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-773324844', 'metadata': {'Type': 'work'}}}} Jun 06 21:04:27.737645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:04:27.737645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:27.737645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 06 21:04:27.737645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 06 21:04:27.737645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 06 21:04:27.737645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise error Jun 06 21:04:27.737645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 06 21:04:27.737645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:27.737645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 06 21:04:27.737645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 06 21:04:27.737645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:27.737645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 06 21:04:27.737645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi '0' Jun 06 21:04:27.737645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:27.737645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:04:27.737645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:27.737645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:27.737645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:04:27.737645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:04:27.737645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:04:27.737645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:04:27.739628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 21:04:27.739628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 21:04:27.739628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:04:27.739628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:04:27.739628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 06 21:04:27.739628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 06 21:04:27.739628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 06 21:04:27.739628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 06 21:04:27.739628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 06 21:04:27.739628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 06 21:04:27.739628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 06 21:04:27.739628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:27.739628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:04:27.739628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:27.739628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:27.739628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:04:27.739628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:04:27.739628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 06 21:04:27.739628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 06 21:04:27.741884 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 06 21:04:27.741884 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:27.741884 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b371c734-1344-4c9a-ad98-e031462308d7 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:04:27.741884 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-b371c734-1344-4c9a-ad98-e031462308d7 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.262785 Jun 06 21:04:27.741884 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 1/2] 10.222.0.33 () {60 vars in 1155 bytes} [Mon Jun 6 21:04:27 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 266 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 06 21:04:27.754461 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fc2756e3-ae7d-40a3-8aa5-e00b1eca4316 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] Action: 'create', calling method: .version_select at 0x7f2727f24940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-228917866", "metadata": {"Type": "work"}}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:04:27.758695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fc2756e3-ae7d-40a3-8aa5-e00b1eca4316 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] Request method failure captured: Jun 06 21:04:27.758695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 06 21:04:27.758695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:04:27.758695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:04:27.758695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:04:27.758695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 118 Jun 06 21:04:27.758695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:04:27.758695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:04:27.758695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:04:27.758695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:04:27.758695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinmvao5LKSkcQTGGgD27188MrWjEWRbMM9PkgYLQu84pHUnPUGQdVcWEWjszpel8Yf5iNBde0_aNNZ9KyUmsL394W_JrcpfhLH8oHV-hebHopfwgaQQoNWSbB2-iYkGkX9v0HaVMZzVijkGA-VwnXrtfAoMHfhSBss0xs3DedOmjT7Ak Jun 06 21:04:27.758695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:04:27.758695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:04:27.758695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:04:27.758695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:04:27.758695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:04:27.758695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:04:27.758695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 84a495ebc66440419f2475ab298ef29a Jun 06 21:04:27.758695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesNegativeTest-102567390 Jun 06 21:04:27.758695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:04:27.758695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:04:27.768615 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/84a495ebc66440419f2475ab298ef29a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_84a495ebc66440419f2475ab298ef29a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/84a495ebc66440419f2475ab298ef29a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/84a495ebc66440419f2475ab298ef29a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:04:27.768615 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesNegativeTest-102567390 Jun 06 21:04:27.768615 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 84a495ebc66440419f2475ab298ef29a Jun 06 21:04:27.768615 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesNegativeTest-102567390 Jun 06 21:04:27.768615 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesNegativeTest-102567390-project Jun 06 21:04:27.768615 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:04:27.768615 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:04:27.768615 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: e1ce45ce4783427e8ee91607e9fcc7a3 Jun 06 21:04:27.768615 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesNegativeTest-102567390-project Jun 06 21:04:27.768615 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Jun 06 21:04:27.768615 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-228917866", "metadata": {"Type": "work"}}} Jun 06 21:04:27.768615 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: Jun 06 21:04:27.768615 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 06 21:04:27.770939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-228917866', 'metadata': {'Type': 'work'}}}} Jun 06 21:04:27.770939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:04:27.770939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:27.770939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 06 21:04:27.770939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 06 21:04:27.770939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 06 21:04:27.770939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise error Jun 06 21:04:27.770939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 06 21:04:27.770939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:04:27.770939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 06 21:04:27.770939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 06 21:04:27.770939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:04:27.770939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 06 21:04:27.770939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi '' Jun 06 21:04:27.770939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:04:27.770939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:04:27.770939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:04:27.770939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:27.770939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:04:27.770939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:04:27.770939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:04:27.770939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:04:27.774065 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 21:04:27.774065 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 21:04:27.774065 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:04:27.774065 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:04:27.774065 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 06 21:04:27.774065 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 06 21:04:27.774065 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 06 21:04:27.774065 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 06 21:04:27.774065 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 06 21:04:27.774065 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 06 21:04:27.774065 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 06 21:04:27.774065 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:04:27.774065 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:04:27.774065 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:04:27.774065 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:27.774065 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:04:27.774065 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:04:27.774065 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 06 21:04:27.774065 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 06 21:04:27.776663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 06 21:04:27.776663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:04:27.776663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fc2756e3-ae7d-40a3-8aa5-e00b1eca4316 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:04:27.776663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fc2756e3-ae7d-40a3-8aa5-e00b1eca4316 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010512 Jun 06 21:04:27.776663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 2/3] 10.222.0.33 () {60 vars in 1155 bytes} [Mon Jun 6 21:04:27 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 06 21:04:27.777381 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=3 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:27.777381 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=3 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:27.777381 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=3 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:27.777381 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=3 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:27.779503 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-292183b4-aeaf-4598-8d41-95164b72b5c4 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] Calling method '.version_select at 0x7f2727e960d0>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:30.811613 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4d544f62-0893-434c-ac06-33144819f751 tempest-VolumesGetTestJSON-1741655284 tempest-VolumesGetTestJSON-1741655284-project] Action: 'create', calling method: .version_select at 0x7f2727f08a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1389100078", "metadata": {"Type": "work"}}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:04:30.822337 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-292183b4-aeaf-4598-8d41-95164b72b5c4 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] HTTP exception thrown: Volume tempest-invalid-1446412121 could not be found. Jun 06 21:04:30.826231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-292183b4-aeaf-4598-8d41-95164b72b5c4 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] Request method failure captured: Jun 06 21:04:30.826231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1446412121 HTTP/1.1 Jun 06 21:04:30.826231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:04:30.826231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:04:30.826231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:04:30.826231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 0 Jun 06 21:04:30.826231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:04:30.826231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:04:30.826231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:04:30.826231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:04:30.826231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinmvao5LKSkcQTGGgD27188MrWjEWRbMM9PkgYLQu84pHUnPUGQdVcWEWjszpel8Yf5iNBde0_aNNZ9KyUmsL394W_JrcpfhLH8oHV-hebHopfwgaQQoNWSbB2-iYkGkX9v0HaVMZzVijkGA-VwnXrtfAoMHfhSBss0xs3DedOmjT7Ak Jun 06 21:04:30.826231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:04:30.826231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:04:30.826231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:04:30.826231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:04:30.826231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:04:30.826231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:04:30.826231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: 84a495ebc66440419f2475ab298ef29a Jun 06 21:04:30.826231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-VolumesNegativeTest-102567390 Jun 06 21:04:30.826231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:04:30.826231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:04:30.828811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/84a495ebc66440419f2475ab298ef29a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_84a495ebc66440419f2475ab298ef29a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/84a495ebc66440419f2475ab298ef29a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/84a495ebc66440419f2475ab298ef29a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:04:30.828811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-VolumesNegativeTest-102567390 Jun 06 21:04:30.828811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: 84a495ebc66440419f2475ab298ef29a Jun 06 21:04:30.828811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-VolumesNegativeTest-102567390 Jun 06 21:04:30.828811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-VolumesNegativeTest-102567390-project Jun 06 21:04:30.828811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:04:30.828811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:04:30.828811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: e1ce45ce4783427e8ee91607e9fcc7a3 Jun 06 21:04:30.828811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-VolumesNegativeTest-102567390-project Jun 06 21:04:30.828811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: Jun 06 21:04:30.828811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Volume tempest-invalid-1446412121 could not be found. Jun 06 21:04:30.828811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'id': 'tempest-invalid-1446412121'} Jun 06 21:04:30.828811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:04:30.837842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:30.837842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 21:04:30.837842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 21:04:30.837842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 21:04:30.837842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 21:04:30.837842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 21:04:30.837842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 21:04:30.837842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 21:04:30.837842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 21:04:30.837842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 21:04:30.837842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 21:04:30.837842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 21:04:30.837842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 21:04:30.837842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 21:04:30.837842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 21:04:30.837842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1446412121 could not be found. (HTTP 404) (Request-ID: req-7557d422-0060-4a34-be43-fcc4b2430893) Jun 06 21:04:30.837842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:30.837842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:04:30.837842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:30.842334 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:30.842334 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 06 21:04:30.842334 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 06 21:04:30.842334 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 21:04:30.842334 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 21:04:30.842334 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 21:04:30.842334 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 21:04:30.842334 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 21:04:30.842334 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 21:04:30.842334 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 21:04:30.842334 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 21:04:30.842334 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 21:04:30.842334 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 21:04:30.842334 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 21:04:30.842334 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 21:04:30.842334 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 21:04:30.842334 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 21:04:30.842334 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 21:04:30.842334 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 21:04:30.844659 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 21:04:30.844659 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 21:04:30.844659 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 21:04:30.844659 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 21:04:30.844659 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1446412121 could not be found. Jun 06 21:04:30.844659 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:30.844659 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:04:30.844659 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:30.844659 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:30.844659 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:04:30.844659 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:04:30.844659 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:04:30.844659 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:04:30.844659 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 21:04:30.844659 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 21:04:30.844659 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:04:30.844659 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:04:30.844659 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 06 21:04:30.844659 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:04:30.844659 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1446412121 could not be found. Jun 06 21:04:30.846926 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:30.846926 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:04:30.846926 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:30.846926 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:30.846926 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:04:30.846926 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:04:30.846926 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:04:30.846926 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:04:30.846926 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1446412121 could not be found. Jun 06 21:04:30.846926 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:30.846926 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-292183b4-aeaf-4598-8d41-95164b72b5c4 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] Returning 404 to user: Volume tempest-invalid-1446412121 could not be found. {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:04:30.846926 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-292183b4-aeaf-4598-8d41-95164b72b5c4 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1446412121" status: 404 len: 99 microversion: 2.1 time: 3.059103 Jun 06 21:04:30.846926 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 2/4] 10.222.0.33 () {58 vars in 1217 bytes} [Mon Jun 6 21:04:27 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1446412121 => generated 99 bytes in 3061 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 06 21:04:30.849700 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-51122db0-dc43-4aee-88ba-87a647087e84 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005718 Jun 06 21:04:30.851669 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 3/5] 10.222.0.33 () {58 vars in 1139 bytes} [Mon Jun 6 21:04:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 15 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 06 21:04:30.864880 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-9ba4a443-c7a6-4637-b818-3adbcea98a54 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009760 Jun 06 21:04:30.872535 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 4/6] 10.222.0.33 () {58 vars in 1136 bytes} [Mon Jun 6 21:04:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 06 21:04:30.880827 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2c90b199-a3f8-4f43-ad01-1410a3145676 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] Calling method '.version_select at 0x7f2727dabdc0>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:30.954136 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-2c90b199-a3f8-4f43-ad01-1410a3145676 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] HTTP exception thrown: Volume 4f4eb5d4-df51-46bf-9453-9683a927c37e could not be found. Jun 06 21:04:30.957801 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2c90b199-a3f8-4f43-ad01-1410a3145676 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] Request method failure captured: Jun 06 21:04:30.957801 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: DELETE /compute/v2.1/os-volumes/4f4eb5d4-df51-46bf-9453-9683a927c37e HTTP/1.1 Jun 06 21:04:30.957801 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:04:30.957801 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:04:30.957801 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:04:30.957801 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 0 Jun 06 21:04:30.957801 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:04:30.957801 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:04:30.957801 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:04:30.957801 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:04:30.957801 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinmvao5LKSkcQTGGgD27188MrWjEWRbMM9PkgYLQu84pHUnPUGQdVcWEWjszpel8Yf5iNBde0_aNNZ9KyUmsL394W_JrcpfhLH8oHV-hebHopfwgaQQoNWSbB2-iYkGkX9v0HaVMZzVijkGA-VwnXrtfAoMHfhSBss0xs3DedOmjT7Ak Jun 06 21:04:30.957801 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:04:30.957801 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:04:30.957801 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:04:30.957801 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:04:30.957801 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:04:30.957801 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:04:30.957801 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: 84a495ebc66440419f2475ab298ef29a Jun 06 21:04:30.957801 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-VolumesNegativeTest-102567390 Jun 06 21:04:30.957801 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:04:30.957801 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:04:30.960377 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/84a495ebc66440419f2475ab298ef29a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_84a495ebc66440419f2475ab298ef29a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/84a495ebc66440419f2475ab298ef29a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/84a495ebc66440419f2475ab298ef29a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:04:30.960377 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-VolumesNegativeTest-102567390 Jun 06 21:04:30.960377 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: 84a495ebc66440419f2475ab298ef29a Jun 06 21:04:30.960377 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-VolumesNegativeTest-102567390 Jun 06 21:04:30.960377 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-VolumesNegativeTest-102567390-project Jun 06 21:04:30.960377 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:04:30.960377 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:04:30.960377 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: e1ce45ce4783427e8ee91607e9fcc7a3 Jun 06 21:04:30.960377 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-VolumesNegativeTest-102567390-project Jun 06 21:04:30.960377 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: Jun 06 21:04:30.960377 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Volume 4f4eb5d4-df51-46bf-9453-9683a927c37e could not be found. Jun 06 21:04:30.960377 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'id': '4f4eb5d4-df51-46bf-9453-9683a927c37e'} Jun 06 21:04:30.960377 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:04:30.962563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:30.962563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 21:04:30.962563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 21:04:30.962563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 21:04:30.962563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 21:04:30.962563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 21:04:30.962563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 21:04:30.962563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 21:04:30.962563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 21:04:30.962563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 21:04:30.962563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 21:04:30.962563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 21:04:30.962563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 21:04:30.962563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 21:04:30.962563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 21:04:30.962563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f4eb5d4-df51-46bf-9453-9683a927c37e could not be found. (HTTP 404) (Request-ID: req-c06a7a82-9733-47a2-80df-7e5e16b920d2) Jun 06 21:04:30.962563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:30.962563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:04:30.962563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:30.966522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:30.966522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 06 21:04:30.966522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 06 21:04:30.966522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 21:04:30.966522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 21:04:30.966522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 21:04:30.966522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 21:04:30.966522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 21:04:30.966522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 21:04:30.966522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 21:04:30.966522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 21:04:30.966522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 21:04:30.966522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 21:04:30.966522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 21:04:30.966522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 21:04:30.966522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 21:04:30.966522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 21:04:30.966522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 21:04:30.966522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 21:04:30.971403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 21:04:30.971403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 21:04:30.971403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 21:04:30.971403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 21:04:30.971403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f4eb5d4-df51-46bf-9453-9683a927c37e could not be found. Jun 06 21:04:30.971403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:30.971403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:04:30.971403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:30.971403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:30.971403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:04:30.971403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:04:30.971403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:04:30.971403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:04:30.971403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 21:04:30.971403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 21:04:30.971403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:04:30.971403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:04:30.971403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 06 21:04:30.971403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:04:30.975406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f4eb5d4-df51-46bf-9453-9683a927c37e could not be found. Jun 06 21:04:30.975406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:30.975406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:04:30.975406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:30.975406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:30.975406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:04:30.975406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:04:30.975406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:04:30.975406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:04:30.975406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f4eb5d4-df51-46bf-9453-9683a927c37e could not be found. Jun 06 21:04:30.975406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:30.975406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2c90b199-a3f8-4f43-ad01-1410a3145676 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] Returning 404 to user: Volume 4f4eb5d4-df51-46bf-9453-9683a927c37e could not be found. {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:04:30.975406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-2c90b199-a3f8-4f43-ad01-1410a3145676 tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/4f4eb5d4-df51-46bf-9453-9683a927c37e" status: 404 len: 109 microversion: 2.1 time: 0.085620 Jun 06 21:04:30.975406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 5/7] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jun 6 21:04:30 2022] DELETE /compute/v2.1/os-volumes/4f4eb5d4-df51-46bf-9453-9683a927c37e => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:04:30.978666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-4e9cc03f-d887-4fdd-a918-e2d134009f3e tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] Calling method '.version_select at 0x7f2727d57a60>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:31.054881 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-4e9cc03f-d887-4fdd-a918-e2d134009f3e tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] HTTP exception thrown: Volume 4da8ce6d-7781-4cab-8320-1aef513c8999 could not be found. Jun 06 21:04:31.057128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-4e9cc03f-d887-4fdd-a918-e2d134009f3e tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] Request method failure captured: Jun 06 21:04:31.057128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: GET /compute/v2.1/os-volumes/4da8ce6d-7781-4cab-8320-1aef513c8999 HTTP/1.1 Jun 06 21:04:31.057128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:04:31.057128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:04:31.057128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:04:31.057128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 0 Jun 06 21:04:31.057128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:04:31.057128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:04:31.057128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:04:31.057128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:04:31.057128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinmvao5LKSkcQTGGgD27188MrWjEWRbMM9PkgYLQu84pHUnPUGQdVcWEWjszpel8Yf5iNBde0_aNNZ9KyUmsL394W_JrcpfhLH8oHV-hebHopfwgaQQoNWSbB2-iYkGkX9v0HaVMZzVijkGA-VwnXrtfAoMHfhSBss0xs3DedOmjT7Ak Jun 06 21:04:31.057128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:04:31.057128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:04:31.057128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:04:31.057128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:04:31.057128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:04:31.057128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:04:31.057128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: 84a495ebc66440419f2475ab298ef29a Jun 06 21:04:31.057128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-VolumesNegativeTest-102567390 Jun 06 21:04:31.057128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:04:31.057128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:04:31.060019 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/84a495ebc66440419f2475ab298ef29a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_84a495ebc66440419f2475ab298ef29a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/84a495ebc66440419f2475ab298ef29a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/84a495ebc66440419f2475ab298ef29a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:04:31.060019 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-VolumesNegativeTest-102567390 Jun 06 21:04:31.060019 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: 84a495ebc66440419f2475ab298ef29a Jun 06 21:04:31.060019 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-VolumesNegativeTest-102567390 Jun 06 21:04:31.060019 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-VolumesNegativeTest-102567390-project Jun 06 21:04:31.060019 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:04:31.060019 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:04:31.060019 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: e1ce45ce4783427e8ee91607e9fcc7a3 Jun 06 21:04:31.060019 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-VolumesNegativeTest-102567390-project Jun 06 21:04:31.060019 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: Jun 06 21:04:31.060019 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Volume 4da8ce6d-7781-4cab-8320-1aef513c8999 could not be found. Jun 06 21:04:31.060019 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'id': '4da8ce6d-7781-4cab-8320-1aef513c8999'} Jun 06 21:04:31.060019 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:04:31.062178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:31.062178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 21:04:31.062178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 21:04:31.062178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 21:04:31.062178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 21:04:31.062178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 21:04:31.062178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 21:04:31.062178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 21:04:31.062178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 21:04:31.062178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 21:04:31.062178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 21:04:31.062178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 21:04:31.062178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 21:04:31.062178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 21:04:31.062178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 21:04:31.062178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4da8ce6d-7781-4cab-8320-1aef513c8999 could not be found. (HTTP 404) (Request-ID: req-f260b0cc-6a12-4f01-a732-9c0ca501d594) Jun 06 21:04:31.062178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:31.062178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:04:31.062178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:31.065422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:31.065422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 21:04:31.065422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 21:04:31.065422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 21:04:31.065422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 21:04:31.065422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 21:04:31.065422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 21:04:31.065422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 21:04:31.065422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 21:04:31.065422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 21:04:31.065422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 21:04:31.065422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 21:04:31.065422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 21:04:31.065422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 21:04:31.065422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 21:04:31.065422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 21:04:31.065422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 21:04:31.065422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 21:04:31.065422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 21:04:31.068666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 21:04:31.068666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 21:04:31.068666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 21:04:31.068666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 21:04:31.068666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4da8ce6d-7781-4cab-8320-1aef513c8999 could not be found. Jun 06 21:04:31.068666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:31.068666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:04:31.068666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:31.068666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:31.068666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:04:31.068666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:04:31.068666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:04:31.068666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:04:31.068666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 21:04:31.068666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 21:04:31.068666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:04:31.068666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:04:31.068666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 21:04:31.068666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:04:31.074649 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4da8ce6d-7781-4cab-8320-1aef513c8999 could not be found. Jun 06 21:04:31.074649 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:31.074649 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:04:31.074649 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:31.074649 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:31.074649 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:04:31.074649 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:04:31.074649 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:04:31.074649 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:04:31.074649 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4da8ce6d-7781-4cab-8320-1aef513c8999 could not be found. Jun 06 21:04:31.074649 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:04:31.074649 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-4e9cc03f-d887-4fdd-a918-e2d134009f3e tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] Returning 404 to user: Volume 4da8ce6d-7781-4cab-8320-1aef513c8999 could not be found. {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:04:31.074649 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-4e9cc03f-d887-4fdd-a918-e2d134009f3e tempest-VolumesNegativeTest-102567390 tempest-VolumesNegativeTest-102567390-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/4da8ce6d-7781-4cab-8320-1aef513c8999" status: 404 len: 109 microversion: 2.1 time: 0.092564 Jun 06 21:04:31.078895 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 6/8] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 6 21:04:30 2022] GET /compute/v2.1/os-volumes/4da8ce6d-7781-4cab-8320-1aef513c8999 => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:04:34.242994 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4d544f62-0893-434c-ac06-33144819f751 tempest-VolumesGetTestJSON-1741655284 tempest-VolumesGetTestJSON-1741655284-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.662957 Jun 06 21:04:34.245262 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 3/9] 10.222.0.33 () {60 vars in 1155 bytes} [Mon Jun 6 21:04:29 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4667 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 06 21:04:34.284783 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-39c47a33-16ab-4bc8-acc5-15510a0f1fd9 tempest-VolumesGetTestJSON-1741655284 tempest-VolumesGetTestJSON-1741655284-project] Calling method '.version_select at 0x7f2727dabee0>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:34.412536 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-96f2caec-8564-4977-b255-cb8596d9705b tempest-VolumesTestJSON-677550642 tempest-VolumesTestJSON-677550642-project] Calling method '.version_select at 0x7f2727d8baf0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:34.502141 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-39c47a33-16ab-4bc8-acc5-15510a0f1fd9 tempest-VolumesGetTestJSON-1741655284 tempest-VolumesGetTestJSON-1741655284-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/51509780-445e-469b-a6d5-2cb239e6e41f" status: 200 len: 353 microversion: 2.1 time: 0.245003 Jun 06 21:04:34.503425 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 7/10] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 6 21:04:34 2022] GET /compute/v2.1/os-volumes/51509780-445e-469b-a6d5-2cb239e6e41f => generated 353 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:04:34.603514 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-96f2caec-8564-4977-b255-cb8596d9705b tempest-VolumesTestJSON-677550642 tempest-VolumesTestJSON-677550642-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/3951486b-9373-4a2b-b813-7a36c40f0aba" status: 200 len: 350 microversion: 2.1 time: 0.205775 Jun 06 21:04:34.613879 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 4/11] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 6 21:04:34 2022] GET /compute/v2.1/os-volumes/3951486b-9373-4a2b-b813-7a36c40f0aba => generated 350 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:04:35.487717 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-486694ce-2885-45a0-a2d7-0a1497805a01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-305241150", "imageRef": "e4266a01-7d22-4036-91e8-3ec50e3369c1", "flavorRef": "452", "networks": [{"uuid": "09a30cf1-907e-4e6f-bd90-b99a20e5ea1b"}]}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:04:35.521271 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2b11e95c-79c1-4c61-a63a-957a554a76b9 tempest-VolumesGetTestJSON-1741655284 tempest-VolumesGetTestJSON-1741655284-project] Calling method '.version_select at 0x7f2727d9b280>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:35.728307 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2b11e95c-79c1-4c61-a63a-957a554a76b9 tempest-VolumesGetTestJSON-1741655284 tempest-VolumesGetTestJSON-1741655284-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/51509780-445e-469b-a6d5-2cb239e6e41f" status: 200 len: 354 microversion: 2.1 time: 0.210814 Jun 06 21:04:35.729065 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 5/12] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 6 21:04:35 2022] GET /compute/v2.1/os-volumes/51509780-445e-469b-a6d5-2cb239e6e41f => generated 354 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:04:35.736180 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.network.neutron [None req-486694ce-2885-45a0-a2d7-0a1497805a01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] validate_networks() for [('09a30cf1-907e-4e6f-bd90-b99a20e5ea1b', None, None, None, None, None)] {{(pid=117860) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 21:04:35.747234 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-43f5a169-97fc-4ee7-826a-04e71a13cb15 tempest-VolumesGetTestJSON-1741655284 tempest-VolumesGetTestJSON-1741655284-project] Calling method '.version_select at 0x7f2727d8bd30>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:35.965337 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-43f5a169-97fc-4ee7-826a-04e71a13cb15 tempest-VolumesGetTestJSON-1741655284 tempest-VolumesGetTestJSON-1741655284-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/51509780-445e-469b-a6d5-2cb239e6e41f" status: 200 len: 354 microversion: 2.1 time: 0.223221 Jun 06 21:04:35.967214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 6/13] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 6 21:04:35 2022] GET /compute/v2.1/os-volumes/51509780-445e-469b-a6d5-2cb239e6e41f => generated 354 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:04:35.998405 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c83a3139-a84a-4241-b661-7c3bba08bf8a tempest-VolumesGetTestJSON-1741655284 tempest-VolumesGetTestJSON-1741655284-project] Calling method '.version_select at 0x7f2727d9b4c0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:36.304020 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c83a3139-a84a-4241-b661-7c3bba08bf8a tempest-VolumesGetTestJSON-1741655284 tempest-VolumesGetTestJSON-1741655284-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/51509780-445e-469b-a6d5-2cb239e6e41f" status: 202 len: 0 microversion: 2.1 time: 0.310436 Jun 06 21:04:36.304611 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 7/14] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jun 6 21:04:35 2022] DELETE /compute/v2.1/os-volumes/51509780-445e-469b-a6d5-2cb239e6e41f => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 21:04:36.316306 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fa885148-bc39-40dd-92c4-b476a38b88de tempest-VolumesGetTestJSON-1741655284 tempest-VolumesGetTestJSON-1741655284-project] Calling method '.version_select at 0x7f2727d9b9d0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:36.478677 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fa885148-bc39-40dd-92c4-b476a38b88de tempest-VolumesGetTestJSON-1741655284 tempest-VolumesGetTestJSON-1741655284-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/51509780-445e-469b-a6d5-2cb239e6e41f" status: 200 len: 353 microversion: 2.1 time: 0.167038 Jun 06 21:04:36.480515 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 8/15] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 6 21:04:36 2022] GET /compute/v2.1/os-volumes/51509780-445e-469b-a6d5-2cb239e6e41f => generated 353 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:04:36.703263 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6c37876e-f442-4624-a0b9-b8f0922a2634 tempest-VolumesTestJSON-677550642 tempest-VolumesTestJSON-677550642-project] Calling method '.version_select at 0x7f2727d9bca0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:36.856374 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6c37876e-f442-4624-a0b9-b8f0922a2634 tempest-VolumesTestJSON-677550642 tempest-VolumesTestJSON-677550642-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/81b810f9-e8a3-4fbf-a091-787d864525bc" status: 200 len: 350 microversion: 2.1 time: 0.169310 Jun 06 21:04:36.858829 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 9/16] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 6 21:04:36 2022] GET /compute/v2.1/os-volumes/81b810f9-e8a3-4fbf-a091-787d864525bc => generated 350 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:04:37.499025 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-47a03b64-8972-4949-a866-7127b8a3b027 tempest-VolumesGetTestJSON-1741655284 tempest-VolumesGetTestJSON-1741655284-project] Calling method '.version_select at 0x7f2727d9b1f0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:37.597022 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-47a03b64-8972-4949-a866-7127b8a3b027 tempest-VolumesGetTestJSON-1741655284 tempest-VolumesGetTestJSON-1741655284-project] HTTP exception thrown: Volume 51509780-445e-469b-a6d5-2cb239e6e41f could not be found. Jun 06 21:04:37.609503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-47a03b64-8972-4949-a866-7127b8a3b027 tempest-VolumesGetTestJSON-1741655284 tempest-VolumesGetTestJSON-1741655284-project] Request method failure captured: Jun 06 21:04:37.609503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/os-volumes/51509780-445e-469b-a6d5-2cb239e6e41f HTTP/1.1 Jun 06 21:04:37.609503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:04:37.609503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:04:37.609503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:04:37.609503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:04:37.609503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:04:37.609503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:04:37.609503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:04:37.609503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:04:37.609503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinmvdAz0cr0PgZAtJCTC_5pZk9h9o4aogR-9ztYnODumviTTA_7cJyXIfiilTTiFufWexXxAuFdft9ITnLR-D690mDZZGq0KiCEighu2ROTikK371kYfuFJlsmlNiVOnm1NMP4J0q72YfWp4I9KY4Qh3r4ZP-zTd2VPGASaxQPE9lxY4 Jun 06 21:04:37.609503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:04:37.609503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:04:37.609503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:04:37.609503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:04:37.609503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:04:37.609503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:04:37.609503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: c1a4dae8c2004be29cd9abd52fac2269 Jun 06 21:04:37.609503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesGetTestJSON-1741655284 Jun 06 21:04:37.609503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:04:37.609503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:04:37.612089 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c1a4dae8c2004be29cd9abd52fac2269"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_c1a4dae8c2004be29cd9abd52fac2269"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/c1a4dae8c2004be29cd9abd52fac2269"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/c1a4dae8c2004be29cd9abd52fac2269"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:04:37.612089 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesGetTestJSON-1741655284 Jun 06 21:04:37.612089 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: c1a4dae8c2004be29cd9abd52fac2269 Jun 06 21:04:37.612089 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesGetTestJSON-1741655284 Jun 06 21:04:37.612089 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesGetTestJSON-1741655284-project Jun 06 21:04:37.612089 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:04:37.612089 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:04:37.612089 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: ebbccef7f2ea4ddfbac2722bd2d0af24 Jun 06 21:04:37.612089 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesGetTestJSON-1741655284-project Jun 06 21:04:37.612089 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: Jun 06 21:04:37.612089 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Volume 51509780-445e-469b-a6d5-2cb239e6e41f could not be found. Jun 06 21:04:37.612089 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '51509780-445e-469b-a6d5-2cb239e6e41f'} Jun 06 21:04:37.612089 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:04:37.613484 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:37.613484 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 21:04:37.613484 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 21:04:37.613484 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 21:04:37.613484 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 21:04:37.613484 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 21:04:37.613484 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 21:04:37.613484 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 21:04:37.613484 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 21:04:37.613484 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 21:04:37.613484 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 21:04:37.613484 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 21:04:37.613484 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 21:04:37.613484 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 21:04:37.613484 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 21:04:37.613484 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 51509780-445e-469b-a6d5-2cb239e6e41f could not be found. (HTTP 404) (Request-ID: req-05c4ecfa-d0f3-4bcb-a709-dceb11642292) Jun 06 21:04:37.613484 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:04:37.613484 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:04:37.613484 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:04:37.615571 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:37.615571 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 21:04:37.615571 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 21:04:37.615571 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 21:04:37.615571 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 21:04:37.615571 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 21:04:37.615571 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 21:04:37.615571 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 21:04:37.615571 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 21:04:37.615571 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 21:04:37.615571 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 21:04:37.615571 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 21:04:37.615571 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 21:04:37.615571 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 21:04:37.615571 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 21:04:37.615571 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 21:04:37.615571 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 21:04:37.615571 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 21:04:37.615571 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 21:04:37.618734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 21:04:37.618734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 21:04:37.618734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 21:04:37.618734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 21:04:37.618734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 51509780-445e-469b-a6d5-2cb239e6e41f could not be found. Jun 06 21:04:37.618734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:04:37.618734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:04:37.618734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:04:37.618734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:37.618734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:04:37.618734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:04:37.618734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:04:37.618734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:04:37.618734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 21:04:37.618734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 21:04:37.618734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:04:37.618734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:04:37.618734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 21:04:37.618734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:04:37.622602 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 51509780-445e-469b-a6d5-2cb239e6e41f could not be found. Jun 06 21:04:37.622602 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:04:37.622602 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:04:37.622602 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:04:37.622602 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:04:37.622602 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:04:37.622602 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:04:37.622602 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:04:37.622602 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:04:37.622602 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 51509780-445e-469b-a6d5-2cb239e6e41f could not be found. Jun 06 21:04:37.622602 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:04:37.680564 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-47a03b64-8972-4949-a866-7127b8a3b027 tempest-VolumesGetTestJSON-1741655284 tempest-VolumesGetTestJSON-1741655284-project] Returning 404 to user: Volume 51509780-445e-469b-a6d5-2cb239e6e41f could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:04:37.693850 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-47a03b64-8972-4949-a866-7127b8a3b027 tempest-VolumesGetTestJSON-1741655284 tempest-VolumesGetTestJSON-1741655284-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/51509780-445e-469b-a6d5-2cb239e6e41f" status: 404 len: 109 microversion: 2.1 time: 0.190191 Jun 06 21:04:37.708227 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 10/17] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 6 21:04:37 2022] GET /compute/v2.1/os-volumes/51509780-445e-469b-a6d5-2cb239e6e41f => generated 109 bytes in 209 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:04:38.822301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-486694ce-2885-45a0-a2d7-0a1497805a01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Flavor limits 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 21:04:38.825204 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-486694ce-2885-45a0-a2d7-0a1497805a01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Image limits 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 21:04:38.826170 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-486694ce-2885-45a0-a2d7-0a1497805a01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Flavor pref 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 21:04:38.826889 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-486694ce-2885-45a0-a2d7-0a1497805a01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Image pref 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 21:04:38.827634 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-486694ce-2885-45a0-a2d7-0a1497805a01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 21:04:38.867854 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-486694ce-2885-45a0-a2d7-0a1497805a01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:04:38.868674 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-486694ce-2885-45a0-a2d7-0a1497805a01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:04:38.869842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-486694ce-2885-45a0-a2d7-0a1497805a01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:04:38.872421 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-486694ce-2885-45a0-a2d7-0a1497805a01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:04:38.970926 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-486694ce-2885-45a0-a2d7-0a1497805a01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Getting quotas for project cdd447d1ebbf403bbf62efc88834bdca. Resources: {'ram', 'cores', 'instances'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:04:38.998750 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-486694ce-2885-45a0-a2d7-0a1497805a01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Getting quotas for user 39d92849843e49e7833f03ca38cb8367 and project cdd447d1ebbf403bbf62efc88834bdca. Resources: {'ram', 'cores', 'instances'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:04:39.019963 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-486694ce-2885-45a0-a2d7-0a1497805a01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Going to run 1 instances... {{(pid=117860) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 21:04:39.023528 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-486694ce-2885-45a0-a2d7-0a1497805a01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4266a01-7d22-4036-91e8-3ec50e3369c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 21:04:39.199422 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-18478729-9f3e-4032-afe0-0ef39414732d tempest-VolumesTestJSON-677550642 tempest-VolumesTestJSON-677550642-project] Calling method '.version_select at 0x7f2727d6c430>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:39.214552 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-486694ce-2885-45a0-a2d7-0a1497805a01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.573470 Jun 06 21:04:39.217618 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 8/18] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 6 21:04:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 4578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 21:04:39.241178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-106ef019-4646-488f-8357-03811be15527 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:39.247960 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-106ef019-4646-488f-8357-03811be15527 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:04:39.418238 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-18478729-9f3e-4032-afe0-0ef39414732d tempest-VolumesTestJSON-677550642 tempest-VolumesTestJSON-677550642-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/8ec699d3-0845-4f29-983a-1784d4f39a2e" status: 200 len: 350 microversion: 2.1 time: 0.211551 Jun 06 21:04:39.418238 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 11/19] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 6 21:04:39 2022] GET /compute/v2.1/os-volumes/8ec699d3-0845-4f29-983a-1784d4f39a2e => generated 350 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:04:39.427022 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4bf141dd-7411-45f4-9b98-712758111c08 tempest-VolumesTestJSON-677550642 tempest-VolumesTestJSON-677550642-project] Calling method '.version_select at 0x7f2727d6ca60>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:39.506943 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-106ef019-4646-488f-8357-03811be15527 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:04:39.541074 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-106ef019-4646-488f-8357-03811be15527 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1214 microversion: 2.1 time: 0.312275 Jun 06 21:04:39.544926 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 9/20] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:04:39 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1214 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:04:39.601494 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4bf141dd-7411-45f4-9b98-712758111c08 tempest-VolumesTestJSON-677550642 tempest-VolumesTestJSON-677550642-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.179499 Jun 06 21:04:39.602130 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 12/21] 10.222.0.33 () {58 vars in 1133 bytes} [Mon Jun 6 21:04:39 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:04:39.623816 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-99a90f60-a905-46ee-90d0-575f093ef70e tempest-VolumesTestJSON-677550642 tempest-VolumesTestJSON-677550642-project] Calling method '.version_select at 0x7f2727e59280>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:39.813410 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-99a90f60-a905-46ee-90d0-575f093ef70e tempest-VolumesTestJSON-677550642 tempest-VolumesTestJSON-677550642-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.193982 Jun 06 21:04:39.814390 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 10/22] 10.222.0.33 () {58 vars in 1148 bytes} [Mon Jun 6 21:04:39 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:04:39.827834 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6eb2ab47-035f-404d-be46-ee4fbf92a68c tempest-VolumesTestJSON-677550642 tempest-VolumesTestJSON-677550642-project] Calling method '.version_select at 0x7f2727d6cdc0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:40.029160 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6eb2ab47-035f-404d-be46-ee4fbf92a68c tempest-VolumesTestJSON-677550642 tempest-VolumesTestJSON-677550642-project] 10.222.0.33 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.205934 Jun 06 21:04:40.030026 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 13/23] 10.222.0.33 () {58 vars in 1133 bytes} [Mon Jun 6 21:04:39 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:04:40.044034 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-c97be00e-8fae-45bb-b418-124784cad91c tempest-VolumesTestJSON-677550642 tempest-VolumesTestJSON-677550642-project] Calling method '.version_select at 0x7f2726c1f1f0>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:40.447449 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-c97be00e-8fae-45bb-b418-124784cad91c tempest-VolumesTestJSON-677550642 tempest-VolumesTestJSON-677550642-project] 10.222.0.33 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.409758 Jun 06 21:04:40.448826 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 11/24] 10.222.0.33 () {58 vars in 1166 bytes} [Mon Jun 6 21:04:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:04:40.461063 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c546b90c-7d5b-4df2-a115-f18cbcead859 tempest-VolumesTestJSON-677550642 tempest-VolumesTestJSON-677550642-project] Calling method '.version_select at 0x7f2727d790d0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:40.573764 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-942a047f-6e63-44cb-aa86-faa27a40ac34 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:40.574793 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-942a047f-6e63-44cb-aa86-faa27a40ac34 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:04:40.725627 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c546b90c-7d5b-4df2-a115-f18cbcead859 tempest-VolumesTestJSON-677550642 tempest-VolumesTestJSON-677550642-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.268434 Jun 06 21:04:40.726880 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 14/25] 10.222.0.33 () {58 vars in 1169 bytes} [Mon Jun 6 21:04:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:04:40.743195 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-58bd6370-b099-483e-9154-e5813dda8544 tempest-VolumesTestJSON-677550642 tempest-VolumesTestJSON-677550642-project] Calling method '.version_select at 0x7f2727d79d30>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:40.758696 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-942a047f-6e63-44cb-aa86-faa27a40ac34 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:04:40.784629 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-942a047f-6e63-44cb-aa86-faa27a40ac34 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1214 microversion: 2.1 time: 0.217204 Jun 06 21:04:40.791851 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 12/26] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:04:40 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1214 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:04:41.112205 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-58bd6370-b099-483e-9154-e5813dda8544 tempest-VolumesTestJSON-677550642 tempest-VolumesTestJSON-677550642-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.375035 Jun 06 21:04:41.112822 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 15/27] 10.222.0.33 () {58 vars in 1154 bytes} [Mon Jun 6 21:04:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:04:41.125671 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-9723209b-cbff-473b-9af6-a70b16b76ce3 tempest-VolumesTestJSON-677550642 tempest-VolumesTestJSON-677550642-project] Calling method '.version_select at 0x7f2726c1fca0>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:41.373969 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-9723209b-cbff-473b-9af6-a70b16b76ce3 tempest-VolumesTestJSON-677550642 tempest-VolumesTestJSON-677550642-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.250428 Jun 06 21:04:41.380168 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 13/28] 10.222.0.33 () {58 vars in 1187 bytes} [Mon Jun 6 21:04:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:04:41.405942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a1100668-1457-401a-b29e-a661bdfa0ac7 tempest-VolumesTestJSON-677550642 tempest-VolumesTestJSON-677550642-project] Calling method '.version_select at 0x7f2727d79c10>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:41.768176 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a1100668-1457-401a-b29e-a661bdfa0ac7 tempest-VolumesTestJSON-677550642 tempest-VolumesTestJSON-677550642-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.375169 Jun 06 21:04:41.772043 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 16/29] 10.222.0.33 () {58 vars in 1154 bytes} [Mon Jun 6 21:04:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:04:41.835507 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-998162a3-ca51-4f50-8166-21ded4b8ac9a tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:41.837126 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-998162a3-ca51-4f50-8166-21ded4b8ac9a tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:04:42.437989 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-998162a3-ca51-4f50-8166-21ded4b8ac9a tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:04:42.471705 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-998162a3-ca51-4f50-8166-21ded4b8ac9a tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1214 microversion: 2.1 time: 0.664623 Jun 06 21:04:42.501540 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 14/30] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:04:41 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1214 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:04:43.516177 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-03543733-33d1-44cc-9883-8a5892ed0408 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:43.518907 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-03543733-33d1-44cc-9883-8a5892ed0408 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:04:43.621018 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-03543733-33d1-44cc-9883-8a5892ed0408 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:04:43.622576 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-03543733-33d1-44cc-9883-8a5892ed0408 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:04:43.624404 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-03543733-33d1-44cc-9883-8a5892ed0408 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:04:43.632131 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-03543733-33d1-44cc-9883-8a5892ed0408 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:04:44.691324 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-03543733-33d1-44cc-9883-8a5892ed0408 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:04:44.773203 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-03543733-33d1-44cc-9883-8a5892ed0408 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1210 microversion: 2.1 time: 1.261745 Jun 06 21:04:44.797664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 17/31] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:04:43 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1210 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:04:45.806210 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-93509b7e-8cc6-4ba3-a1a8-10b8be77f377 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:45.807044 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-93509b7e-8cc6-4ba3-a1a8-10b8be77f377 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:04:45.822232 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-93509b7e-8cc6-4ba3-a1a8-10b8be77f377 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:04:45.824961 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-93509b7e-8cc6-4ba3-a1a8-10b8be77f377 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:04:45.827763 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-93509b7e-8cc6-4ba3-a1a8-10b8be77f377 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:04:45.829375 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-93509b7e-8cc6-4ba3-a1a8-10b8be77f377 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:04:46.433338 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-93509b7e-8cc6-4ba3-a1a8-10b8be77f377 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:04:46.457006 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-93509b7e-8cc6-4ba3-a1a8-10b8be77f377 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1272 microversion: 2.1 time: 0.655401 Jun 06 21:04:46.470444 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 15/32] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:04:45 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1272 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:04:47.482374 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-dc248edb-161a-4cbd-98a2-aeb4cf43e768 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:47.483905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-dc248edb-161a-4cbd-98a2-aeb4cf43e768 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:04:47.508795 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dc248edb-161a-4cbd-98a2-aeb4cf43e768 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:04:47.509464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dc248edb-161a-4cbd-98a2-aeb4cf43e768 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:04:47.511352 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dc248edb-161a-4cbd-98a2-aeb4cf43e768 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:04:47.513628 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dc248edb-161a-4cbd-98a2-aeb4cf43e768 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:04:48.026684 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-dc248edb-161a-4cbd-98a2-aeb4cf43e768 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:04:48.043002 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-dc248edb-161a-4cbd-98a2-aeb4cf43e768 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1272 microversion: 2.1 time: 0.570673 Jun 06 21:04:48.044068 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 18/33] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:04:47 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1272 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:04:49.063081 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-edc480aa-0e9f-4f19-a0ac-4b029a1c6a42 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:49.064485 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-edc480aa-0e9f-4f19-a0ac-4b029a1c6a42 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:04:49.068268 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=2 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:49.090078 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-edc480aa-0e9f-4f19-a0ac-4b029a1c6a42 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:04:49.091103 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-edc480aa-0e9f-4f19-a0ac-4b029a1c6a42 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:04:49.095137 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-edc480aa-0e9f-4f19-a0ac-4b029a1c6a42 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:04:49.099065 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-edc480aa-0e9f-4f19-a0ac-4b029a1c6a42 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:04:49.603324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-edc480aa-0e9f-4f19-a0ac-4b029a1c6a42 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:04:49.634141 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-edc480aa-0e9f-4f19-a0ac-4b029a1c6a42 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1272 microversion: 2.1 time: 0.561682 Jun 06 21:04:49.641203 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 16/34] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:04:49 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1272 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:04:50.671242 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2f9246d9-94e8-40a7-8aa0-444e56b3dd85 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:50.680328 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-2f9246d9-94e8-40a7-8aa0-444e56b3dd85 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:04:50.711438 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2f9246d9-94e8-40a7-8aa0-444e56b3dd85 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:04:50.714143 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2f9246d9-94e8-40a7-8aa0-444e56b3dd85 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:04:50.716293 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2f9246d9-94e8-40a7-8aa0-444e56b3dd85 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:04:50.719889 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2f9246d9-94e8-40a7-8aa0-444e56b3dd85 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:04:51.325679 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-745038f6-3f1f-4c1b-8735-7cdf78385f0e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Action: 'create', calling method: .version_select at 0x7f2727c3eaf0>, body: {"keypair": {"name": "tempest-keypair-1875207055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQF8jLeId7RKCrH5G3Cd4vwgE5s7vFDz3qdixTJvlA/vPFQb5Vq74jruSDdTNTNn1QMRMnkg14oZbdqAfZvjS3Smmy/2I4cHyec3VMnvC1o6Ll1AB4zto3zGjLbe8Zuqw=="}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:04:51.492389 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-745038f6-3f1f-4c1b-8735-7cdf78385f0e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Getting quotas for project 5a771f1ab27f40aca2d546901cdcecda. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:04:51.511111 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-745038f6-3f1f-4c1b-8735-7cdf78385f0e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Getting quotas for user 8713cb23a93147f8b52f88e240c81d6f and project 5a771f1ab27f40aca2d546901cdcecda. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:04:51.708360 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-745038f6-3f1f-4c1b-8735-7cdf78385f0e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.667430 Jun 06 21:04:51.708925 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 19/35] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jun 6 21:04:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:04:52.450559 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=12 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:04:53.350958 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2f9246d9-94e8-40a7-8aa0-444e56b3dd85 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:04:53.411631 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-2f9246d9-94e8-40a7-8aa0-444e56b3dd85 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1314 microversion: 2.1 time: 2.735890 Jun 06 21:04:53.413378 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 17/36] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:04:50 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1314 bytes in 2750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:04:54.447054 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8bc8318f-45f7-4f04-8bee-0977cf5c521f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:54.449161 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8bc8318f-45f7-4f04-8bee-0977cf5c521f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:04:54.467244 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8bc8318f-45f7-4f04-8bee-0977cf5c521f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:04:54.475607 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8bc8318f-45f7-4f04-8bee-0977cf5c521f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:04:54.488564 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8bc8318f-45f7-4f04-8bee-0977cf5c521f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:04:54.489757 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8bc8318f-45f7-4f04-8bee-0977cf5c521f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:04:55.814743 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8bc8318f-45f7-4f04-8bee-0977cf5c521f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:04:55.861612 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8bc8318f-45f7-4f04-8bee-0977cf5c521f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1314 microversion: 2.1 time: 1.421772 Jun 06 21:04:55.886070 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 20/37] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:04:54 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1314 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:04:56.910573 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2f690b4f-a5ea-4ff0-87a0-2609d1abaa01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:56.913913 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-2f690b4f-a5ea-4ff0-87a0-2609d1abaa01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:04:56.981510 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2f690b4f-a5ea-4ff0-87a0-2609d1abaa01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:04:56.984262 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2f690b4f-a5ea-4ff0-87a0-2609d1abaa01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:04:56.986196 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2f690b4f-a5ea-4ff0-87a0-2609d1abaa01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:04:56.997382 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2f690b4f-a5ea-4ff0-87a0-2609d1abaa01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:04:58.604088 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2f690b4f-a5ea-4ff0-87a0-2609d1abaa01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:04:58.628123 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-2f690b4f-a5ea-4ff0-87a0-2609d1abaa01 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1314 microversion: 2.1 time: 1.715648 Jun 06 21:04:58.638410 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 18/38] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:04:56 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1314 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:04:59.651034 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bf177cc7-70e9-4d99-9c3f-2a649ce20a8c tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:04:59.653277 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bf177cc7-70e9-4d99-9c3f-2a649ce20a8c tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:04:59.698099 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf177cc7-70e9-4d99-9c3f-2a649ce20a8c tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:04:59.704040 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf177cc7-70e9-4d99-9c3f-2a649ce20a8c tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:04:59.709912 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf177cc7-70e9-4d99-9c3f-2a649ce20a8c tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:04:59.713180 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf177cc7-70e9-4d99-9c3f-2a649ce20a8c tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:00.791941 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bf177cc7-70e9-4d99-9c3f-2a649ce20a8c tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:00.850090 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bf177cc7-70e9-4d99-9c3f-2a649ce20a8c tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1314 microversion: 2.1 time: 1.206335 Jun 06 21:05:00.851147 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 21/39] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:04:59 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1314 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:01.565771 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-9767bbc3-e998-44ff-ab13-76e5200e8e11 req-08430ab3-02c3-4b35-a129-bc5b47505437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7aab9b-98d9-4c7b-9155-076474742331", "tag": "a21aef07-33e5-41f2-8e86-579975d74f4c"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:05:01.610252 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:01.621336 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-9767bbc3-e998-44ff-ab13-76e5200e8e11 req-08430ab3-02c3-4b35-a129-bc5b47505437 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:01.621992 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-9767bbc3-e998-44ff-ab13-76e5200e8e11 req-08430ab3-02c3-4b35-a129-bc5b47505437 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:01.719955 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-9767bbc3-e998-44ff-ab13-76e5200e8e11 req-08430ab3-02c3-4b35-a129-bc5b47505437 service nova] Creating event network-changed:a21aef07-33e5-41f2-8e86-579975d74f4c for instance af7aab9b-98d9-4c7b-9155-076474742331 on hv-cinder-84488 Jun 06 21:05:01.720628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-9767bbc3-e998-44ff-ab13-76e5200e8e11 req-08430ab3-02c3-4b35-a129-bc5b47505437 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 06 21:05:01.727554 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2e653182-3736-4af1-adf8-07c2c5868d26 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:01.729353 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2e653182-3736-4af1-adf8-07c2c5868d26 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:01.738247 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2e653182-3736-4af1-adf8-07c2c5868d26 None None] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:01.739388 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2e653182-3736-4af1-adf8-07c2c5868d26 None None] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:01.785566 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.compute.rpcapi [None req-2e653182-3736-4af1-adf8-07c2c5868d26 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 06 21:05:01.786734 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2e653182-3736-4af1-adf8-07c2c5868d26 None None] Releasing lock "compute-rpcapi-router" {{(pid=117860) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 06 21:05:01.852804 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-2e653182-3736-4af1-adf8-07c2c5868d26 None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.313109 Jun 06 21:05:01.855530 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 19/40] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:05:01.887169 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1f771010-0566-4347-96fb-d2739ef7c85f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:01.898956 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1f771010-0566-4347-96fb-d2739ef7c85f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:01.922152 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=4 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:01.954646 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1f771010-0566-4347-96fb-d2739ef7c85f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:01.962481 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1f771010-0566-4347-96fb-d2739ef7c85f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:01.963955 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1f771010-0566-4347-96fb-d2739ef7c85f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:01.964626 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1f771010-0566-4347-96fb-d2739ef7c85f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:03.134854 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1f771010-0566-4347-96fb-d2739ef7c85f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:03.148681 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1f771010-0566-4347-96fb-d2739ef7c85f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1314 microversion: 2.1 time: 1.269358 Jun 06 21:05:03.149048 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 22/41] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:01 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1314 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:04.171746 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-880b30c8-16e6-4c39-acbf-5ca23bea5760 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:04.172715 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-880b30c8-16e6-4c39-acbf-5ca23bea5760 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:04.181946 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-f13837dc-a701-4901-ab30-9f1bccae69d8 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Action: 'create', calling method: .version_select at 0x7f2726b70820>, body: {"keypair": {"name": "tempest-keypair-1727888521", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJIkpsz7qvh65VkPP4HHCuYBkSkPdXvkleOxJUzt0c+GxTYeaEjxTCCbmc5uE1mS3UOaCjziuWtoGDY6SMAVch8W2LAB9EHaE+DzVOGjxHHpmJfSJCPSYCMzTznLHUlmzA=="}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:05:04.193261 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-880b30c8-16e6-4c39-acbf-5ca23bea5760 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:04.195028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-880b30c8-16e6-4c39-acbf-5ca23bea5760 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:04.198240 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-880b30c8-16e6-4c39-acbf-5ca23bea5760 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:04.200827 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-880b30c8-16e6-4c39-acbf-5ca23bea5760 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:04.315531 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-f13837dc-a701-4901-ab30-9f1bccae69d8 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Getting quotas for project 576ccf22c37f44fcbe449838cb5673f6. Resources: {'key_pairs'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:05:04.326115 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-f13837dc-a701-4901-ab30-9f1bccae69d8 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Getting quotas for user 602aaa469bed4617b1a0385087066c93 and project 576ccf22c37f44fcbe449838cb5673f6. Resources: {'key_pairs'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:05:04.439276 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-f13837dc-a701-4901-ab30-9f1bccae69d8 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.115263 Jun 06 21:05:04.440657 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 20/42] 10.222.0.33 () {62 vars in 1199 bytes} [Mon Jun 6 21:05:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1119 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 06 21:05:04.662687 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-06742727-f58c-4a29-a0ad-a8e6a0608289 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2105076000", "imageRef": "e4266a01-7d22-4036-91e8-3ec50e3369c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "caa56bb2-4a47-4aeb-99db-1e89b9e32e70"}], "security_groups": [{"name": "tempest-securitygroup--227728117"}], "key_name": "tempest-keypair-1875207055", "user_data": "}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:05:04.712857 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-880b30c8-16e6-4c39-acbf-5ca23bea5760 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:04.723737 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-880b30c8-16e6-4c39-acbf-5ca23bea5760 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1314 microversion: 2.1 time: 0.559262 Jun 06 21:05:04.727590 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 23/43] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:04 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1314 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:04.995768 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.network.neutron [None req-06742727-f58c-4a29-a0ad-a8e6a0608289 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] validate_networks() for [('caa56bb2-4a47-4aeb-99db-1e89b9e32e70', None, None, None, None, None)] {{(pid=117860) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 21:05:05.748177 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-064f74d4-6d92-427a-9628-ba5f8923347a tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:05.752901 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-064f74d4-6d92-427a-9628-ba5f8923347a tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:05.793103 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-064f74d4-6d92-427a-9628-ba5f8923347a tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:05.797505 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-064f74d4-6d92-427a-9628-ba5f8923347a tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:05.802641 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-064f74d4-6d92-427a-9628-ba5f8923347a tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:05.805519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-064f74d4-6d92-427a-9628-ba5f8923347a tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:06.432966 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-06742727-f58c-4a29-a0ad-a8e6a0608289 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Flavor limits 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 21:05:06.434050 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-06742727-f58c-4a29-a0ad-a8e6a0608289 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Image limits 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 21:05:06.434935 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-06742727-f58c-4a29-a0ad-a8e6a0608289 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Flavor pref 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 21:05:06.435795 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-06742727-f58c-4a29-a0ad-a8e6a0608289 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Image pref 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 21:05:06.437379 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-06742727-f58c-4a29-a0ad-a8e6a0608289 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 21:05:06.484350 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-06742727-f58c-4a29-a0ad-a8e6a0608289 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:06.486669 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-06742727-f58c-4a29-a0ad-a8e6a0608289 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:06.489088 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-06742727-f58c-4a29-a0ad-a8e6a0608289 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:06.496097 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-06742727-f58c-4a29-a0ad-a8e6a0608289 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:06.607760 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-06742727-f58c-4a29-a0ad-a8e6a0608289 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Getting quotas for project 5a771f1ab27f40aca2d546901cdcecda. Resources: {'ram', 'cores', 'instances'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:05:06.624567 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-06742727-f58c-4a29-a0ad-a8e6a0608289 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Getting quotas for user 8713cb23a93147f8b52f88e240c81d6f and project 5a771f1ab27f40aca2d546901cdcecda. Resources: {'ram', 'cores', 'instances'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:05:06.695668 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-06742727-f58c-4a29-a0ad-a8e6a0608289 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Going to run 1 instances... {{(pid=117860) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 21:05:06.708544 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-06742727-f58c-4a29-a0ad-a8e6a0608289 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4266a01-7d22-4036-91e8-3ec50e3369c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 21:05:06.772544 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-064f74d4-6d92-427a-9628-ba5f8923347a tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:06.808708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=41 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:06.819545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-064f74d4-6d92-427a-9628-ba5f8923347a tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1314 microversion: 2.1 time: 1.079661 Jun 06 21:05:06.842983 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 24/44] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:05 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1314 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:07.009300 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-06742727-f58c-4a29-a0ad-a8e6a0608289 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.344669 Jun 06 21:05:07.010493 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 21/45] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 6 21:05:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 2356 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 06 21:05:07.028834 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-799f1a1d-5a74-493b-875d-b5af3372f7f7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:07.030147 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-799f1a1d-5a74-493b-875d-b5af3372f7f7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:07.083981 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:07.331478 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-799f1a1d-5a74-493b-875d-b5af3372f7f7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:07.358697 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-799f1a1d-5a74-493b-875d-b5af3372f7f7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 200 len: 1242 microversion: 2.1 time: 0.336231 Jun 06 21:05:07.361632 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 25/46] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:07 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 1242 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:07.845138 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-1c7590dc-8122-45db-9a44-3d243dbeada9 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:07.848058 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-1c7590dc-8122-45db-9a44-3d243dbeada9 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:07.887388 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1c7590dc-8122-45db-9a44-3d243dbeada9 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:07.888124 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1c7590dc-8122-45db-9a44-3d243dbeada9 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:07.899594 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1c7590dc-8122-45db-9a44-3d243dbeada9 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:07.900944 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1c7590dc-8122-45db-9a44-3d243dbeada9 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:08.048550 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=33 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:08.392985 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3912b561-a143-44cc-8cd6-01bbfea0c0fb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:08.393601 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3912b561-a143-44cc-8cd6-01bbfea0c0fb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:08.458612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-1c7590dc-8122-45db-9a44-3d243dbeada9 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:08.496307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-1c7590dc-8122-45db-9a44-3d243dbeada9 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1314 microversion: 2.1 time: 0.648061 Jun 06 21:05:08.497807 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 22/47] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:07 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1314 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:08.673033 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3912b561-a143-44cc-8cd6-01bbfea0c0fb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:08.722741 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3912b561-a143-44cc-8cd6-01bbfea0c0fb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 200 len: 1242 microversion: 2.1 time: 0.339503 Jun 06 21:05:08.726271 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 26/48] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:08 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 1242 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:09.527151 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-5e213a0c-7c68-4849-aae3-457489c19228 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:09.530339 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-5e213a0c-7c68-4849-aae3-457489c19228 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:09.558354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5e213a0c-7c68-4849-aae3-457489c19228 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:09.561928 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5e213a0c-7c68-4849-aae3-457489c19228 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:09.565243 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5e213a0c-7c68-4849-aae3-457489c19228 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:09.567749 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5e213a0c-7c68-4849-aae3-457489c19228 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:09.718497 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b2181159-3609-4908-9682-a4d01a1aeffe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1978785886", "imageRef": "e4266a01-7d22-4036-91e8-3ec50e3369c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a66e5149-d2b2-496e-8506-4294d2b66e2c"}], "security_groups": [{"name": "tempest-securitygroup--1892570475"}], "key_name": "tempest-keypair-1727888521", "user_data": "}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:05:10.000790 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-5e213a0c-7c68-4849-aae3-457489c19228 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:10.021206 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-5e213a0c-7c68-4849-aae3-457489c19228 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1314 microversion: 2.1 time: 0.501221 Jun 06 21:05:10.027339 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 23/49] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:09 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1314 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:10.042382 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-424bfe81-f4f1-4efa-b297-26c0940d2f0d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:10.043418 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-424bfe81-f4f1-4efa-b297-26c0940d2f0d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:10.071962 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-424bfe81-f4f1-4efa-b297-26c0940d2f0d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:10.072857 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-424bfe81-f4f1-4efa-b297-26c0940d2f0d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:10.076287 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-424bfe81-f4f1-4efa-b297-26c0940d2f0d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:10.080688 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-424bfe81-f4f1-4efa-b297-26c0940d2f0d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:10.153793 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-b2181159-3609-4908-9682-a4d01a1aeffe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] validate_networks() for [('a66e5149-d2b2-496e-8506-4294d2b66e2c', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 21:05:10.239904 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-424bfe81-f4f1-4efa-b297-26c0940d2f0d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:10.254519 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-424bfe81-f4f1-4efa-b297-26c0940d2f0d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 200 len: 1294 microversion: 2.1 time: 0.222823 Jun 06 21:05:10.269538 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 24/50] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:10 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 1294 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:11.062755 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-86d330d2-b5af-4006-ab1e-74f1c4783019 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:11.068639 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-86d330d2-b5af-4006-ab1e-74f1c4783019 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:11.084317 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-86d330d2-b5af-4006-ab1e-74f1c4783019 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:11.085597 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-86d330d2-b5af-4006-ab1e-74f1c4783019 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:11.087515 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-86d330d2-b5af-4006-ab1e-74f1c4783019 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:11.100135 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-86d330d2-b5af-4006-ab1e-74f1c4783019 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:11.453823 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-86d330d2-b5af-4006-ab1e-74f1c4783019 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:11.468857 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-86d330d2-b5af-4006-ab1e-74f1c4783019 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1314 microversion: 2.1 time: 0.418114 Jun 06 21:05:11.480313 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 25/51] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:11 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:11.487200 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0ea40ce8-aaf7-4c48-8dea-2f832e102719 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:11.487827 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-0ea40ce8-aaf7-4c48-8dea-2f832e102719 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:11.496365 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0ea40ce8-aaf7-4c48-8dea-2f832e102719 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:11.497062 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0ea40ce8-aaf7-4c48-8dea-2f832e102719 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:11.498377 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0ea40ce8-aaf7-4c48-8dea-2f832e102719 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:11.499084 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0ea40ce8-aaf7-4c48-8dea-2f832e102719 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:11.621175 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-0ea40ce8-aaf7-4c48-8dea-2f832e102719 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:11.638413 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-0ea40ce8-aaf7-4c48-8dea-2f832e102719 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 200 len: 1300 microversion: 2.1 time: 0.156454 Jun 06 21:05:11.640537 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 26/52] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:11 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 1300 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:12.118540 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-b2181159-3609-4908-9682-a4d01a1aeffe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 21:05:12.119412 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-b2181159-3609-4908-9682-a4d01a1aeffe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 21:05:12.120233 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-b2181159-3609-4908-9682-a4d01a1aeffe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 21:05:12.120929 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-b2181159-3609-4908-9682-a4d01a1aeffe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 21:05:12.121704 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-b2181159-3609-4908-9682-a4d01a1aeffe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 21:05:12.164807 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2181159-3609-4908-9682-a4d01a1aeffe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:12.165756 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2181159-3609-4908-9682-a4d01a1aeffe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:12.169752 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2181159-3609-4908-9682-a4d01a1aeffe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:12.172095 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2181159-3609-4908-9682-a4d01a1aeffe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:12.274926 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-b2181159-3609-4908-9682-a4d01a1aeffe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Getting quotas for project 576ccf22c37f44fcbe449838cb5673f6. Resources: {'ram', 'cores', 'instances'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:05:12.286384 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-b2181159-3609-4908-9682-a4d01a1aeffe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Getting quotas for user 602aaa469bed4617b1a0385087066c93 and project 576ccf22c37f44fcbe449838cb5673f6. Resources: {'ram', 'cores', 'instances'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:05:12.332169 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b2181159-3609-4908-9682-a4d01a1aeffe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 21:05:12.342801 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b2181159-3609-4908-9682-a4d01a1aeffe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4266a01-7d22-4036-91e8-3ec50e3369c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 21:05:12.358739 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-47368b64-17e7-462e-9da3-aa80465cbcc7 req-4f66e03a-b7f2-4962-abca-7dbdc47d4c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7aab9b-98d9-4c7b-9155-076474742331", "name": "network-vif-plugged", "status": "completed", "tag": "a21aef07-33e5-41f2-8e86-579975d74f4c"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:05:12.373213 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-47368b64-17e7-462e-9da3-aa80465cbcc7 req-4f66e03a-b7f2-4962-abca-7dbdc47d4c43 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:12.374873 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-47368b64-17e7-462e-9da3-aa80465cbcc7 req-4f66e03a-b7f2-4962-abca-7dbdc47d4c43 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:12.407587 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-47368b64-17e7-462e-9da3-aa80465cbcc7 req-4f66e03a-b7f2-4962-abca-7dbdc47d4c43 service nova] Creating event network-vif-plugged:a21aef07-33e5-41f2-8e86-579975d74f4c for instance af7aab9b-98d9-4c7b-9155-076474742331 on hv-cinder-84488 Jun 06 21:05:12.420272 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-47368b64-17e7-462e-9da3-aa80465cbcc7 req-4f66e03a-b7f2-4962-abca-7dbdc47d4c43 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150313 Jun 06 21:05:12.421800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 27/53] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:05:12.489532 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-1c6047c5-d996-4a3f-a13f-c36be940c51f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:12.491166 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-1c6047c5-d996-4a3f-a13f-c36be940c51f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:12.506671 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1c6047c5-d996-4a3f-a13f-c36be940c51f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:12.508150 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1c6047c5-d996-4a3f-a13f-c36be940c51f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:12.512705 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1c6047c5-d996-4a3f-a13f-c36be940c51f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:12.513538 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1c6047c5-d996-4a3f-a13f-c36be940c51f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:12.520919 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b2181159-3609-4908-9682-a4d01a1aeffe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.809728 Jun 06 21:05:12.521589 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 27/54] 10.222.0.33 () {62 vars in 1187 bytes} [Mon Jun 6 21:05:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 2813 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 06 21:05:12.542504 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e453997b-06e8-43f8-887f-3c50dbb4d950 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:12.543154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e453997b-06e8-43f8-887f-3c50dbb4d950 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:12.712638 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e453997b-06e8-43f8-887f-3c50dbb4d950 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:12.731298 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e453997b-06e8-43f8-887f-3c50dbb4d950 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:12.756760 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e453997b-06e8-43f8-887f-3c50dbb4d950 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:12.760328 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e453997b-06e8-43f8-887f-3c50dbb4d950 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1282 microversion: 2.20 time: 0.222011 Jun 06 21:05:12.779244 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 28/55] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:05:12 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1282 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:05:12.791436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-093f4dd5-31aa-4fec-ac0c-576b38a78efd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:12.792654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-093f4dd5-31aa-4fec-ac0c-576b38a78efd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:12.807329 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-093f4dd5-31aa-4fec-ac0c-576b38a78efd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:12.808622 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-093f4dd5-31aa-4fec-ac0c-576b38a78efd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:12.810929 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-093f4dd5-31aa-4fec-ac0c-576b38a78efd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:12.812225 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-093f4dd5-31aa-4fec-ac0c-576b38a78efd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:12.950280 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-093f4dd5-31aa-4fec-ac0c-576b38a78efd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:12.963154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-093f4dd5-31aa-4fec-ac0c-576b38a78efd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 200 len: 1300 microversion: 2.1 time: 0.180606 Jun 06 21:05:12.963770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 29/56] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:12 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 1300 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:13.778132 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-1c6047c5-d996-4a3f-a13f-c36be940c51f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:13.788844 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d0732977-f594-4125-9038-13dc80e588b6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:13.790803 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d0732977-f594-4125-9038-13dc80e588b6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:13.799851 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-1c6047c5-d996-4a3f-a13f-c36be940c51f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1314 microversion: 2.1 time: 1.316544 Jun 06 21:05:13.802362 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 28/57] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:12 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1314 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:13.817772 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d0732977-f594-4125-9038-13dc80e588b6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:13.820378 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d0732977-f594-4125-9038-13dc80e588b6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:13.822319 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d0732977-f594-4125-9038-13dc80e588b6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:13.824919 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d0732977-f594-4125-9038-13dc80e588b6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:14.004496 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-38670da8-cdb0-4884-a2ed-764ec5f3d6df tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:14.008465 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-38670da8-cdb0-4884-a2ed-764ec5f3d6df tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:14.041448 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-38670da8-cdb0-4884-a2ed-764ec5f3d6df tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:14.048898 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-38670da8-cdb0-4884-a2ed-764ec5f3d6df tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:14.050553 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-38670da8-cdb0-4884-a2ed-764ec5f3d6df tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:14.062413 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-38670da8-cdb0-4884-a2ed-764ec5f3d6df tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:14.218557 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d0732977-f594-4125-9038-13dc80e588b6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:14.235279 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d0732977-f594-4125-9038-13dc80e588b6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:14.237331 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d0732977-f594-4125-9038-13dc80e588b6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:14.238506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d0732977-f594-4125-9038-13dc80e588b6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1286 microversion: 2.20 time: 0.455420 Jun 06 21:05:14.255003 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 30/58] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:05:13 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1286 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:05:14.404558 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-38670da8-cdb0-4884-a2ed-764ec5f3d6df tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:14.427428 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-38670da8-cdb0-4884-a2ed-764ec5f3d6df tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 200 len: 1367 microversion: 2.1 time: 0.438488 Jun 06 21:05:14.429513 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 29/59] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:13 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 1367 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:05:14.824318 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1495da69-c817-4320-aa04-32068f6a222f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:14.825369 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1495da69-c817-4320-aa04-32068f6a222f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:14.844292 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1495da69-c817-4320-aa04-32068f6a222f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:14.845694 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1495da69-c817-4320-aa04-32068f6a222f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:14.848320 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1495da69-c817-4320-aa04-32068f6a222f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:14.849311 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1495da69-c817-4320-aa04-32068f6a222f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:15.271543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-33aa09f9-5091-44fb-9cdb-a0c58dc6728e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:15.275206 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-33aa09f9-5091-44fb-9cdb-a0c58dc6728e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:15.282698 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1495da69-c817-4320-aa04-32068f6a222f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:15.305478 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-33aa09f9-5091-44fb-9cdb-a0c58dc6728e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:15.306289 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-33aa09f9-5091-44fb-9cdb-a0c58dc6728e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:15.307961 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1495da69-c817-4320-aa04-32068f6a222f tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1314 microversion: 2.1 time: 0.489261 Jun 06 21:05:15.309958 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 31/60] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:14 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1314 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:15.319974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-165f4375-6d56-4ff2-9613-d926c44111e1 req-2fd45c40-81dd-45df-812f-74eb956f7eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67813627-cc4f-453f-8b8f-9cec9b130583", "tag": "efe64743-231a-4a9a-84a9-a1c7d29a5935"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:05:15.321760 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-33aa09f9-5091-44fb-9cdb-a0c58dc6728e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:15.322810 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-33aa09f9-5091-44fb-9cdb-a0c58dc6728e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:15.368039 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-165f4375-6d56-4ff2-9613-d926c44111e1 req-2fd45c40-81dd-45df-812f-74eb956f7eb2 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:15.368505 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-165f4375-6d56-4ff2-9613-d926c44111e1 req-2fd45c40-81dd-45df-812f-74eb956f7eb2 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:15.437272 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-165f4375-6d56-4ff2-9613-d926c44111e1 req-2fd45c40-81dd-45df-812f-74eb956f7eb2 service nova] Creating event network-changed:efe64743-231a-4a9a-84a9-a1c7d29a5935 for instance 67813627-cc4f-453f-8b8f-9cec9b130583 on hv-cinder-84488 Jun 06 21:05:15.450305 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-165f4375-6d56-4ff2-9613-d926c44111e1 req-2fd45c40-81dd-45df-812f-74eb956f7eb2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117859) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 06 21:05:15.453155 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9034afbb-29b1-4b3c-a002-3e3c18525e4b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:15.455054 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9034afbb-29b1-4b3c-a002-3e3c18525e4b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:15.456993 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9034afbb-29b1-4b3c-a002-3e3c18525e4b None None] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:15.458358 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9034afbb-29b1-4b3c-a002-3e3c18525e4b None None] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:15.480317 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.compute.rpcapi [None req-9034afbb-29b1-4b3c-a002-3e3c18525e4b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 06 21:05:15.482082 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9034afbb-29b1-4b3c-a002-3e3c18525e4b None None] Releasing lock "compute-rpcapi-router" {{(pid=117859) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 06 21:05:15.520544 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-33aa09f9-5091-44fb-9cdb-a0c58dc6728e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:15.525914 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9034afbb-29b1-4b3c-a002-3e3c18525e4b None None] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208258 Jun 06 21:05:15.527773 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 32/61] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:05:15.536786 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-33aa09f9-5091-44fb-9cdb-a0c58dc6728e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:15.538444 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-33aa09f9-5091-44fb-9cdb-a0c58dc6728e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:15.540918 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f9d10875-90e4-41ef-8505-8699407d8109 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:15.542400 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f9d10875-90e4-41ef-8505-8699407d8109 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:15.547254 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-33aa09f9-5091-44fb-9cdb-a0c58dc6728e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1334 microversion: 2.20 time: 0.291976 Jun 06 21:05:15.547876 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 30/62] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:05:15 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1334 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:05:15.574834 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f9d10875-90e4-41ef-8505-8699407d8109 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:15.575684 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f9d10875-90e4-41ef-8505-8699407d8109 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:15.580723 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f9d10875-90e4-41ef-8505-8699407d8109 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:15.581507 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f9d10875-90e4-41ef-8505-8699407d8109 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:15.874746 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f9d10875-90e4-41ef-8505-8699407d8109 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:15.885810 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f9d10875-90e4-41ef-8505-8699407d8109 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 200 len: 1367 microversion: 2.1 time: 0.355827 Jun 06 21:05:15.887062 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 33/63] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:15 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 1367 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:16.347408 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-53a5d598-2b1d-42ad-be3a-c01a56928597 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:16.348883 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-53a5d598-2b1d-42ad-be3a-c01a56928597 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:16.358722 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-53a5d598-2b1d-42ad-be3a-c01a56928597 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:16.359450 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-53a5d598-2b1d-42ad-be3a-c01a56928597 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:16.360471 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-53a5d598-2b1d-42ad-be3a-c01a56928597 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:16.361111 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-53a5d598-2b1d-42ad-be3a-c01a56928597 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:16.559707 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-53a5d598-2b1d-42ad-be3a-c01a56928597 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:16.563461 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=4 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:16.578584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1ed5a148-2fb6-41fa-8ae7-beb84371af43 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:16.579185 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1ed5a148-2fb6-41fa-8ae7-beb84371af43 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:16.580626 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-53a5d598-2b1d-42ad-be3a-c01a56928597 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1314 microversion: 2.1 time: 0.237618 Jun 06 21:05:16.581886 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 31/64] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:16 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:05:16.587066 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ed5a148-2fb6-41fa-8ae7-beb84371af43 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:16.587506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ed5a148-2fb6-41fa-8ae7-beb84371af43 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:16.588642 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ed5a148-2fb6-41fa-8ae7-beb84371af43 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:16.588755 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ed5a148-2fb6-41fa-8ae7-beb84371af43 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:16.724310 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1ed5a148-2fb6-41fa-8ae7-beb84371af43 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:16.760278 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1ed5a148-2fb6-41fa-8ae7-beb84371af43 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:16.763932 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1ed5a148-2fb6-41fa-8ae7-beb84371af43 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:16.766885 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1ed5a148-2fb6-41fa-8ae7-beb84371af43 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1334 microversion: 2.20 time: 0.192325 Jun 06 21:05:16.768632 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 34/65] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:05:16 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1334 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:05:16.915679 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-930c9172-a013-45eb-ae3c-7a65c77daa95 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:16.916634 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-930c9172-a013-45eb-ae3c-7a65c77daa95 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:16.919716 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=10 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:16.929966 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-930c9172-a013-45eb-ae3c-7a65c77daa95 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:16.930781 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-930c9172-a013-45eb-ae3c-7a65c77daa95 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:16.932285 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-930c9172-a013-45eb-ae3c-7a65c77daa95 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:16.933086 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-930c9172-a013-45eb-ae3c-7a65c77daa95 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:17.131854 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-930c9172-a013-45eb-ae3c-7a65c77daa95 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:17.143273 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-930c9172-a013-45eb-ae3c-7a65c77daa95 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 200 len: 1367 microversion: 2.1 time: 0.234544 Jun 06 21:05:17.144075 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 32/66] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:16 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:17.607643 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b2b7e7ec-c747-4140-ae12-5e8c288093c1 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:17.611296 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b2b7e7ec-c747-4140-ae12-5e8c288093c1 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:17.670883 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2b7e7ec-c747-4140-ae12-5e8c288093c1 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:17.673983 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2b7e7ec-c747-4140-ae12-5e8c288093c1 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:17.682279 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2b7e7ec-c747-4140-ae12-5e8c288093c1 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:17.686191 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2b7e7ec-c747-4140-ae12-5e8c288093c1 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:17.792691 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-c03e3e41-a90e-41ef-bfaa-a6797d18e319 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:17.798105 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-c03e3e41-a90e-41ef-bfaa-a6797d18e319 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:17.851760 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c03e3e41-a90e-41ef-bfaa-a6797d18e319 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:17.852674 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c03e3e41-a90e-41ef-bfaa-a6797d18e319 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:17.854149 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c03e3e41-a90e-41ef-bfaa-a6797d18e319 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:17.854925 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c03e3e41-a90e-41ef-bfaa-a6797d18e319 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:18.199339 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c03e3e41-a90e-41ef-bfaa-a6797d18e319 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:18.211364 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c03e3e41-a90e-41ef-bfaa-a6797d18e319 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:18.222563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c03e3e41-a90e-41ef-bfaa-a6797d18e319 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:18.225065 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-c03e3e41-a90e-41ef-bfaa-a6797d18e319 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1352 microversion: 2.20 time: 0.442309 Jun 06 21:05:18.226108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 33/67] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:05:17 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1352 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:05:18.241246 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-105c3b00-a99a-4778-8c21-0581f04a16fa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:18.242603 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-105c3b00-a99a-4778-8c21-0581f04a16fa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:18.258947 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-105c3b00-a99a-4778-8c21-0581f04a16fa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:18.260422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-105c3b00-a99a-4778-8c21-0581f04a16fa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:18.261316 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-105c3b00-a99a-4778-8c21-0581f04a16fa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:18.261761 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-105c3b00-a99a-4778-8c21-0581f04a16fa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:18.750839 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b2b7e7ec-c747-4140-ae12-5e8c288093c1 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:18.785887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b2b7e7ec-c747-4140-ae12-5e8c288093c1 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1314 microversion: 2.1 time: 1.187928 Jun 06 21:05:18.804810 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 35/68] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:17 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1314 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:18.946431 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-105c3b00-a99a-4778-8c21-0581f04a16fa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:18.985514 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-105c3b00-a99a-4778-8c21-0581f04a16fa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 200 len: 1367 microversion: 2.1 time: 0.755087 Jun 06 21:05:19.004263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 34/69] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:18 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 1367 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:19.263203 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fb754094-1611-4a8c-a340-c0a918700613 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:19.264449 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fb754094-1611-4a8c-a340-c0a918700613 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:19.328735 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb754094-1611-4a8c-a340-c0a918700613 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:19.343234 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb754094-1611-4a8c-a340-c0a918700613 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:19.355362 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb754094-1611-4a8c-a340-c0a918700613 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:19.357452 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb754094-1611-4a8c-a340-c0a918700613 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:19.624325 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fb754094-1611-4a8c-a340-c0a918700613 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:19.634648 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fb754094-1611-4a8c-a340-c0a918700613 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:19.641217 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fb754094-1611-4a8c-a340-c0a918700613 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:19.646486 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fb754094-1611-4a8c-a340-c0a918700613 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1340 microversion: 2.20 time: 0.392730 Jun 06 21:05:19.649565 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 36/70] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:05:19 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1340 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:05:19.821027 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2ca52dc6-7bd2-4797-a706-5ed44b7136d5 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:19.825822 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-2ca52dc6-7bd2-4797-a706-5ed44b7136d5 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:19.858369 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2ca52dc6-7bd2-4797-a706-5ed44b7136d5 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:19.859523 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2ca52dc6-7bd2-4797-a706-5ed44b7136d5 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:19.863497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2ca52dc6-7bd2-4797-a706-5ed44b7136d5 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:19.864372 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2ca52dc6-7bd2-4797-a706-5ed44b7136d5 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:20.015531 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-32f440a6-3c3f-4ffb-b306-44d4ee45098a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:20.021163 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-32f440a6-3c3f-4ffb-b306-44d4ee45098a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:20.040794 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-32f440a6-3c3f-4ffb-b306-44d4ee45098a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:20.042387 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-32f440a6-3c3f-4ffb-b306-44d4ee45098a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:20.051288 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-32f440a6-3c3f-4ffb-b306-44d4ee45098a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:20.054559 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-32f440a6-3c3f-4ffb-b306-44d4ee45098a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:20.566921 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-32f440a6-3c3f-4ffb-b306-44d4ee45098a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:20.580728 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-32f440a6-3c3f-4ffb-b306-44d4ee45098a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 200 len: 1367 microversion: 2.1 time: 0.572093 Jun 06 21:05:20.594717 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 37/71] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:20 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 1367 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:20.672602 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7936d957-ff80-4144-92f6-d6158d5434ba tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:20.673506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7936d957-ff80-4144-92f6-d6158d5434ba tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:20.700193 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2ca52dc6-7bd2-4797-a706-5ed44b7136d5 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:20.714142 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7936d957-ff80-4144-92f6-d6158d5434ba tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:20.715024 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7936d957-ff80-4144-92f6-d6158d5434ba tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:20.725663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7936d957-ff80-4144-92f6-d6158d5434ba tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:20.726513 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7936d957-ff80-4144-92f6-d6158d5434ba tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:20.731832 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-2ca52dc6-7bd2-4797-a706-5ed44b7136d5 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1501 microversion: 2.1 time: 0.919421 Jun 06 21:05:20.732878 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 35/72] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:19 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1501 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:21.588681 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7936d957-ff80-4144-92f6-d6158d5434ba tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:21.603484 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-6dc86430-7c3a-4c31-a335-c390b6c2ee34 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:21.604144 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-6dc86430-7c3a-4c31-a335-c390b6c2ee34 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:21.624452 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6dc86430-7c3a-4c31-a335-c390b6c2ee34 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:21.626685 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6dc86430-7c3a-4c31-a335-c390b6c2ee34 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:21.628177 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7936d957-ff80-4144-92f6-d6158d5434ba tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:21.629395 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6dc86430-7c3a-4c31-a335-c390b6c2ee34 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:21.630512 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6dc86430-7c3a-4c31-a335-c390b6c2ee34 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:21.636234 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7936d957-ff80-4144-92f6-d6158d5434ba tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:21.640611 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7936d957-ff80-4144-92f6-d6158d5434ba tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1408 microversion: 2.20 time: 0.974512 Jun 06 21:05:21.646068 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 38/73] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:05:20 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1408 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:05:22.360333 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-6dc86430-7c3a-4c31-a335-c390b6c2ee34 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:22.384859 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-6dc86430-7c3a-4c31-a335-c390b6c2ee34 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 200 len: 1367 microversion: 2.1 time: 0.786016 Jun 06 21:05:22.387585 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 36/74] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:21 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 1367 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:22.671954 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6cf187e1-8169-4604-9aa7-082d785e4354 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:22.673574 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6cf187e1-8169-4604-9aa7-082d785e4354 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:22.687771 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6cf187e1-8169-4604-9aa7-082d785e4354 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:22.691037 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6cf187e1-8169-4604-9aa7-082d785e4354 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:22.696882 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6cf187e1-8169-4604-9aa7-082d785e4354 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:22.698828 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6cf187e1-8169-4604-9aa7-082d785e4354 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:22.763760 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=12 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:22.997413 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-9f5c2804-f139-4f72-8425-4ac050c4e01b tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09af7ca5-754b-40a6-9c8d-1a3c4a07c15b"}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:05:22.999426 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-9f5c2804-f139-4f72-8425-4ac050c4e01b tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:23.031256 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9f5c2804-f139-4f72-8425-4ac050c4e01b tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:23.036852 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9f5c2804-f139-4f72-8425-4ac050c4e01b tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:23.050694 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9f5c2804-f139-4f72-8425-4ac050c4e01b tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:23.062414 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9f5c2804-f139-4f72-8425-4ac050c4e01b tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:23.252157 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6cf187e1-8169-4604-9aa7-082d785e4354 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:23.270098 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6cf187e1-8169-4604-9aa7-082d785e4354 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:23.273495 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6cf187e1-8169-4604-9aa7-082d785e4354 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:23.276567 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6cf187e1-8169-4604-9aa7-082d785e4354 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1408 microversion: 2.20 time: 0.610867 Jun 06 21:05:23.288458 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 39/75] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:05:22 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1408 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:05:23.406016 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ab94067c-2e67-4f06-a60e-71784d5c9092 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:23.406841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ab94067c-2e67-4f06-a60e-71784d5c9092 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:23.420217 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ab94067c-2e67-4f06-a60e-71784d5c9092 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:23.421446 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ab94067c-2e67-4f06-a60e-71784d5c9092 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:23.423977 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ab94067c-2e67-4f06-a60e-71784d5c9092 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:23.424477 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ab94067c-2e67-4f06-a60e-71784d5c9092 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:23.770963 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ab94067c-2e67-4f06-a60e-71784d5c9092 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:23.785331 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ab94067c-2e67-4f06-a60e-71784d5c9092 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 200 len: 1367 microversion: 2.1 time: 0.385026 Jun 06 21:05:23.786834 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 40/76] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:23 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 1367 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:05:23.920146 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-9f5c2804-f139-4f72-8425-4ac050c4e01b tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "POST /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.935356 Jun 06 21:05:23.922741 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 37/77] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 6 21:05:22 2022] POST /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331/os-volume_attachments => generated 194 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:05:24.297210 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-3263ba5d-2e49-43e1-b334-64c3a6f2d3bd req-334d9b50-ed9d-44bb-9b5e-01666667626c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1886e3bf-c735-4f91-8a2f-0bc6996982e0", "tag": "2e4dc91b-9fa1-4ca1-9827-0ca3ef02a18e"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:05:24.303347 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-febbcb3d-ce5d-4f41-b00b-3692c8935c18 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:24.304151 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-febbcb3d-ce5d-4f41-b00b-3692c8935c18 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:24.320707 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-3263ba5d-2e49-43e1-b334-64c3a6f2d3bd req-334d9b50-ed9d-44bb-9b5e-01666667626c service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:24.321618 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-3263ba5d-2e49-43e1-b334-64c3a6f2d3bd req-334d9b50-ed9d-44bb-9b5e-01666667626c service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:24.336570 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-febbcb3d-ce5d-4f41-b00b-3692c8935c18 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:24.349023 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-febbcb3d-ce5d-4f41-b00b-3692c8935c18 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:24.349023 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-febbcb3d-ce5d-4f41-b00b-3692c8935c18 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:24.349023 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-febbcb3d-ce5d-4f41-b00b-3692c8935c18 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:24.353652 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-3263ba5d-2e49-43e1-b334-64c3a6f2d3bd req-334d9b50-ed9d-44bb-9b5e-01666667626c service nova] Creating event network-changed:2e4dc91b-9fa1-4ca1-9827-0ca3ef02a18e for instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 on hv-cinder-84488 Jun 06 21:05:24.367144 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-3263ba5d-2e49-43e1-b334-64c3a6f2d3bd req-334d9b50-ed9d-44bb-9b5e-01666667626c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.578184 Jun 06 21:05:24.369145 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 41/78] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:05:24.464045 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:24.714789 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-febbcb3d-ce5d-4f41-b00b-3692c8935c18 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:24.725840 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-febbcb3d-ce5d-4f41-b00b-3692c8935c18 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:24.737382 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-febbcb3d-ce5d-4f41-b00b-3692c8935c18 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:24.739591 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-febbcb3d-ce5d-4f41-b00b-3692c8935c18 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1408 microversion: 2.20 time: 0.439258 Jun 06 21:05:24.751402 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 38/79] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:05:24 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1408 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:05:24.817395 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f3625461-41be-497b-abe3-b25c290931db tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:24.818849 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f3625461-41be-497b-abe3-b25c290931db tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:24.840539 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f3625461-41be-497b-abe3-b25c290931db tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:24.842717 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f3625461-41be-497b-abe3-b25c290931db tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:24.844120 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f3625461-41be-497b-abe3-b25c290931db tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:24.845500 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f3625461-41be-497b-abe3-b25c290931db tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:25.125608 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f3625461-41be-497b-abe3-b25c290931db tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:25.170972 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f3625461-41be-497b-abe3-b25c290931db tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 200 len: 1367 microversion: 2.1 time: 0.367386 Jun 06 21:05:25.172162 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 42/80] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:24 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 1367 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:25.765032 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-f73dfb4d-733f-45f3-a396-a190aff7f8a6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:25.768151 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-f73dfb4d-733f-45f3-a396-a190aff7f8a6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:25.793898 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f73dfb4d-733f-45f3-a396-a190aff7f8a6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:25.796159 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f73dfb4d-733f-45f3-a396-a190aff7f8a6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:25.798212 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f73dfb4d-733f-45f3-a396-a190aff7f8a6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:25.800917 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f73dfb4d-733f-45f3-a396-a190aff7f8a6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:26.204188 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ddfbc85c-2a59-43f0-8c17-e04cfdd3a6af tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:26.206069 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ddfbc85c-2a59-43f0-8c17-e04cfdd3a6af tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:26.216856 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=4 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:26.224161 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ddfbc85c-2a59-43f0-8c17-e04cfdd3a6af tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:26.224637 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ddfbc85c-2a59-43f0-8c17-e04cfdd3a6af tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:26.226284 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ddfbc85c-2a59-43f0-8c17-e04cfdd3a6af tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:26.228307 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ddfbc85c-2a59-43f0-8c17-e04cfdd3a6af tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:26.378419 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-f73dfb4d-733f-45f3-a396-a190aff7f8a6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:26.434138 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-f73dfb4d-733f-45f3-a396-a190aff7f8a6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:26.448414 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-f73dfb4d-733f-45f3-a396-a190aff7f8a6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:26.450988 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-f73dfb4d-733f-45f3-a396-a190aff7f8a6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1408 microversion: 2.20 time: 0.694852 Jun 06 21:05:26.465196 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 39/81] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:05:25 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1408 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:05:26.784131 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ddfbc85c-2a59-43f0-8c17-e04cfdd3a6af tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:26.803938 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ddfbc85c-2a59-43f0-8c17-e04cfdd3a6af tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 200 len: 1367 microversion: 2.1 time: 0.603932 Jun 06 21:05:26.812862 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 43/82] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:26 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 1367 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:27.486766 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-85a45c31-5168-4205-881c-b2ae45576c86 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:27.487561 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-85a45c31-5168-4205-881c-b2ae45576c86 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:27.496479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-85a45c31-5168-4205-881c-b2ae45576c86 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:27.497216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-85a45c31-5168-4205-881c-b2ae45576c86 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:27.498309 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-85a45c31-5168-4205-881c-b2ae45576c86 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:27.498915 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-85a45c31-5168-4205-881c-b2ae45576c86 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:27.733798 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-3316524b-5e51-4aa8-a28f-5027e86cf045 req-ff9ab876-a750-4007-a6b4-0f049f0fa2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67813627-cc4f-453f-8b8f-9cec9b130583", "name": "network-vif-plugged", "status": "completed", "tag": "efe64743-231a-4a9a-84a9-a1c7d29a5935"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:05:27.762284 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-3316524b-5e51-4aa8-a28f-5027e86cf045 req-ff9ab876-a750-4007-a6b4-0f049f0fa2f3 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:27.764897 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-3316524b-5e51-4aa8-a28f-5027e86cf045 req-ff9ab876-a750-4007-a6b4-0f049f0fa2f3 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:27.799388 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-3316524b-5e51-4aa8-a28f-5027e86cf045 req-ff9ab876-a750-4007-a6b4-0f049f0fa2f3 service nova] Creating event network-vif-plugged:efe64743-231a-4a9a-84a9-a1c7d29a5935 for instance 67813627-cc4f-453f-8b8f-9cec9b130583 on hv-cinder-84488 Jun 06 21:05:27.822392 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-3316524b-5e51-4aa8-a28f-5027e86cf045 req-ff9ab876-a750-4007-a6b4-0f049f0fa2f3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084282 Jun 06 21:05:27.823677 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 44/83] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:05:27.830621 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-85a45c31-5168-4205-881c-b2ae45576c86 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:27.849189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-85a45c31-5168-4205-881c-b2ae45576c86 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:27.850411 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-aab1c79a-e651-40e1-bed8-d5ce03dd42cf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:27.855311 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-aab1c79a-e651-40e1-bed8-d5ce03dd42cf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:27.856740 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-85a45c31-5168-4205-881c-b2ae45576c86 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:27.860792 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-85a45c31-5168-4205-881c-b2ae45576c86 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1408 microversion: 2.20 time: 0.379171 Jun 06 21:05:27.867307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 40/84] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:05:27 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1408 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:05:27.881867 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aab1c79a-e651-40e1-bed8-d5ce03dd42cf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:27.882645 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aab1c79a-e651-40e1-bed8-d5ce03dd42cf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:27.889043 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aab1c79a-e651-40e1-bed8-d5ce03dd42cf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:27.889809 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aab1c79a-e651-40e1-bed8-d5ce03dd42cf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:28.157211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-aab1c79a-e651-40e1-bed8-d5ce03dd42cf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:28.182807 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-aab1c79a-e651-40e1-bed8-d5ce03dd42cf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 200 len: 1367 microversion: 2.1 time: 0.350132 Jun 06 21:05:28.196617 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 45/85] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:27 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 1367 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:28.894605 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e3bb5ed1-e8a7-46bf-861a-baed3dca3394 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:28.895326 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-e3bb5ed1-e8a7-46bf-861a-baed3dca3394 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:28.903172 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e3bb5ed1-e8a7-46bf-861a-baed3dca3394 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:28.903642 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e3bb5ed1-e8a7-46bf-861a-baed3dca3394 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:28.905288 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e3bb5ed1-e8a7-46bf-861a-baed3dca3394 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:28.906107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e3bb5ed1-e8a7-46bf-861a-baed3dca3394 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:29.212468 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1d480def-a5ca-4755-b3b0-a0bac0f8b58b tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:29.215740 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1d480def-a5ca-4755-b3b0-a0bac0f8b58b tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:29.228216 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d480def-a5ca-4755-b3b0-a0bac0f8b58b tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:29.231190 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d480def-a5ca-4755-b3b0-a0bac0f8b58b tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:29.232801 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d480def-a5ca-4755-b3b0-a0bac0f8b58b tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:29.235177 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d480def-a5ca-4755-b3b0-a0bac0f8b58b tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:29.271962 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e3bb5ed1-e8a7-46bf-861a-baed3dca3394 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:29.284984 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e3bb5ed1-e8a7-46bf-861a-baed3dca3394 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:29.288567 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e3bb5ed1-e8a7-46bf-861a-baed3dca3394 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:29.294507 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-e3bb5ed1-e8a7-46bf-861a-baed3dca3394 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1408 microversion: 2.20 time: 0.404457 Jun 06 21:05:29.296091 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 41/86] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:05:28 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1408 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:05:29.506818 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1d480def-a5ca-4755-b3b0-a0bac0f8b58b tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:29.514383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:29.534144 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1d480def-a5ca-4755-b3b0-a0bac0f8b58b tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 200 len: 1367 microversion: 2.1 time: 0.329263 Jun 06 21:05:29.544722 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 46/87] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:29 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 1367 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:30.318547 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0ae14e7d-9385-44f1-a17c-4fd40cab3a37 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:30.319863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-0ae14e7d-9385-44f1-a17c-4fd40cab3a37 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:30.341685 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0ae14e7d-9385-44f1-a17c-4fd40cab3a37 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:30.342601 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0ae14e7d-9385-44f1-a17c-4fd40cab3a37 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:30.344364 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0ae14e7d-9385-44f1-a17c-4fd40cab3a37 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:30.345352 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0ae14e7d-9385-44f1-a17c-4fd40cab3a37 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:30.560765 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-345946ff-bbf6-44a3-8df2-99b67b274d57 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:30.567845 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-345946ff-bbf6-44a3-8df2-99b67b274d57 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:30.596430 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-345946ff-bbf6-44a3-8df2-99b67b274d57 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:30.598580 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-345946ff-bbf6-44a3-8df2-99b67b274d57 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:30.602502 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-0ae14e7d-9385-44f1-a17c-4fd40cab3a37 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:30.604317 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-345946ff-bbf6-44a3-8df2-99b67b274d57 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:30.607910 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-345946ff-bbf6-44a3-8df2-99b67b274d57 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:30.614614 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-0ae14e7d-9385-44f1-a17c-4fd40cab3a37 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:30.619262 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-0ae14e7d-9385-44f1-a17c-4fd40cab3a37 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:30.621138 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-0ae14e7d-9385-44f1-a17c-4fd40cab3a37 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1408 microversion: 2.20 time: 0.310885 Jun 06 21:05:30.622429 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 42/88] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:05:30 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1408 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:05:30.909990 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-345946ff-bbf6-44a3-8df2-99b67b274d57 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:30.942360 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-345946ff-bbf6-44a3-8df2-99b67b274d57 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 200 len: 1558 microversion: 2.1 time: 0.391738 Jun 06 21:05:30.943744 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 47/89] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:30 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 1558 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:05:30.970864 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-6b376000-4c20-4d04-835e-d7cf890ffa11 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:30.971358 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-6b376000-4c20-4d04-835e-d7cf890ffa11 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:30.978228 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6b376000-4c20-4d04-835e-d7cf890ffa11 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:30.978680 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6b376000-4c20-4d04-835e-d7cf890ffa11 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:30.979503 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6b376000-4c20-4d04-835e-d7cf890ffa11 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:30.980424 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6b376000-4c20-4d04-835e-d7cf890ffa11 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:31.102521 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-6b376000-4c20-4d04-835e-d7cf890ffa11 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.135829 Jun 06 21:05:31.104768 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 43/90] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jun 6 21:05:30 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583/os-interface => generated 285 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:05:31.550603 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-13803092-e3c7-49b8-97a6-4cf7f008a7b7 req-1cead91b-1205-4f5c-969d-35040a2ca4cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1886e3bf-c735-4f91-8a2f-0bc6996982e0", "name": "network-vif-plugged", "status": "completed", "tag": "2e4dc91b-9fa1-4ca1-9827-0ca3ef02a18e"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:05:31.571790 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-13803092-e3c7-49b8-97a6-4cf7f008a7b7 req-1cead91b-1205-4f5c-969d-35040a2ca4cf service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:31.573298 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-13803092-e3c7-49b8-97a6-4cf7f008a7b7 req-1cead91b-1205-4f5c-969d-35040a2ca4cf service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:31.602934 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-13803092-e3c7-49b8-97a6-4cf7f008a7b7 req-1cead91b-1205-4f5c-969d-35040a2ca4cf service nova] Creating event network-vif-plugged:2e4dc91b-9fa1-4ca1-9827-0ca3ef02a18e for instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 on hv-cinder-84488 Jun 06 21:05:31.620993 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-13803092-e3c7-49b8-97a6-4cf7f008a7b7 req-1cead91b-1205-4f5c-969d-35040a2ca4cf service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072149 Jun 06 21:05:31.621910 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 48/91] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:05:31.654574 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b90d2486-00a5-4167-9c53-4dda02d43e7a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:31.655902 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-b90d2486-00a5-4167-9c53-4dda02d43e7a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:31.667528 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b90d2486-00a5-4167-9c53-4dda02d43e7a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:31.671465 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b90d2486-00a5-4167-9c53-4dda02d43e7a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:31.672609 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b90d2486-00a5-4167-9c53-4dda02d43e7a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:31.673431 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b90d2486-00a5-4167-9c53-4dda02d43e7a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:32.494635 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-b90d2486-00a5-4167-9c53-4dda02d43e7a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:32.511601 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-b90d2486-00a5-4167-9c53-4dda02d43e7a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:32.513627 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-b90d2486-00a5-4167-9c53-4dda02d43e7a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:32.516250 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-b90d2486-00a5-4167-9c53-4dda02d43e7a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1408 microversion: 2.20 time: 0.867797 Jun 06 21:05:32.517247 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 44/92] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:05:31 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1408 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:05:33.523093 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-08c45d92-748c-4da8-b3df-6c78f3f5496a req-c962e769-c0cb-4a34-bcd6-b7f6feb95ea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67813627-cc4f-453f-8b8f-9cec9b130583", "tag": "efe64743-231a-4a9a-84a9-a1c7d29a5935"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:05:33.546365 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2c811fb8-f729-471c-84d3-3662f1250475 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:33.549081 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-2c811fb8-f729-471c-84d3-3662f1250475 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:33.570549 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:33.573249 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-08c45d92-748c-4da8-b3df-6c78f3f5496a req-c962e769-c0cb-4a34-bcd6-b7f6feb95ea0 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:33.578215 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-08c45d92-748c-4da8-b3df-6c78f3f5496a req-c962e769-c0cb-4a34-bcd6-b7f6feb95ea0 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:33.585887 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2c811fb8-f729-471c-84d3-3662f1250475 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:33.587417 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2c811fb8-f729-471c-84d3-3662f1250475 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:33.589946 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2c811fb8-f729-471c-84d3-3662f1250475 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:33.590865 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2c811fb8-f729-471c-84d3-3662f1250475 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:33.639487 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-08c45d92-748c-4da8-b3df-6c78f3f5496a req-c962e769-c0cb-4a34-bcd6-b7f6feb95ea0 service nova] Creating event network-changed:efe64743-231a-4a9a-84a9-a1c7d29a5935 for instance 67813627-cc4f-453f-8b8f-9cec9b130583 on hv-cinder-84488 Jun 06 21:05:33.665766 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-08c45d92-748c-4da8-b3df-6c78f3f5496a req-c962e769-c0cb-4a34-bcd6-b7f6feb95ea0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146348 Jun 06 21:05:33.666806 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 49/93] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:05:33.878903 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2c811fb8-f729-471c-84d3-3662f1250475 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:33.894967 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2c811fb8-f729-471c-84d3-3662f1250475 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:33.898636 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2c811fb8-f729-471c-84d3-3662f1250475 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:33.901120 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-2c811fb8-f729-471c-84d3-3662f1250475 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1408 microversion: 2.20 time: 0.362428 Jun 06 21:05:33.902865 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 45/94] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:05:33 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1408 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:05:34.932675 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3d779d2c-50b7-4de7-abfc-d0703bb85a36 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:34.935341 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3d779d2c-50b7-4de7-abfc-d0703bb85a36 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:34.953146 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3d779d2c-50b7-4de7-abfc-d0703bb85a36 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:34.955841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3d779d2c-50b7-4de7-abfc-d0703bb85a36 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:34.958856 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3d779d2c-50b7-4de7-abfc-d0703bb85a36 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:34.960190 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3d779d2c-50b7-4de7-abfc-d0703bb85a36 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:35.303491 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3d779d2c-50b7-4de7-abfc-d0703bb85a36 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:35.312906 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3d779d2c-50b7-4de7-abfc-d0703bb85a36 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:35.315524 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3d779d2c-50b7-4de7-abfc-d0703bb85a36 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:35.317236 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3d779d2c-50b7-4de7-abfc-d0703bb85a36 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1408 microversion: 2.20 time: 0.391103 Jun 06 21:05:35.318919 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 50/95] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:05:34 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1408 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:05:35.498909 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e730285e-2489-4e74-8dfc-262299e31807 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:35.499495 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-e730285e-2489-4e74-8dfc-262299e31807 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:35.514519 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e730285e-2489-4e74-8dfc-262299e31807 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:35.515293 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e730285e-2489-4e74-8dfc-262299e31807 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:35.517296 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e730285e-2489-4e74-8dfc-262299e31807 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:35.518630 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e730285e-2489-4e74-8dfc-262299e31807 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:35.564917 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-e730285e-2489-4e74-8dfc-262299e31807 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Going to try to terminate instance {{(pid=117860) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 21:05:35.755166 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-e730285e-2489-4e74-8dfc-262299e31807 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "DELETE /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 204 len: 0 microversion: 2.1 time: 0.260567 Jun 06 21:05:35.758427 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 46/96] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:05:35 2022] DELETE /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 06 21:05:35.766669 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8e1bb52d-1cab-45b5-a620-588a0e7848e0 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:35.767436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8e1bb52d-1cab-45b5-a620-588a0e7848e0 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:35.778462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8e1bb52d-1cab-45b5-a620-588a0e7848e0 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:35.779002 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8e1bb52d-1cab-45b5-a620-588a0e7848e0 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:35.779804 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8e1bb52d-1cab-45b5-a620-588a0e7848e0 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:35.780261 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8e1bb52d-1cab-45b5-a620-588a0e7848e0 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:36.353147 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-f0b626b6-2d4f-48ca-a8bc-4cc46c486c95 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:36.355010 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-f0b626b6-2d4f-48ca-a8bc-4cc46c486c95 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:36.371778 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f0b626b6-2d4f-48ca-a8bc-4cc46c486c95 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:36.373421 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f0b626b6-2d4f-48ca-a8bc-4cc46c486c95 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:36.375176 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f0b626b6-2d4f-48ca-a8bc-4cc46c486c95 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:36.376494 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f0b626b6-2d4f-48ca-a8bc-4cc46c486c95 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:36.400869 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8e1bb52d-1cab-45b5-a620-588a0e7848e0 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:36.427114 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8e1bb52d-1cab-45b5-a620-588a0e7848e0 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1553 microversion: 2.1 time: 0.663919 Jun 06 21:05:36.428436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 51/97] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:35 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1553 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:36.840539 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-f0b626b6-2d4f-48ca-a8bc-4cc46c486c95 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:36.855210 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-f0b626b6-2d4f-48ca-a8bc-4cc46c486c95 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:36.858553 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-f0b626b6-2d4f-48ca-a8bc-4cc46c486c95 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:36.860863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-f0b626b6-2d4f-48ca-a8bc-4cc46c486c95 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1408 microversion: 2.20 time: 0.516374 Jun 06 21:05:36.862534 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 47/98] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:05:36 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1408 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:05:37.448617 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ec12e1b1-fd22-4988-8658-d59be7f875db tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:37.449663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ec12e1b1-fd22-4988-8658-d59be7f875db tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:37.452597 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:37.462153 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ec12e1b1-fd22-4988-8658-d59be7f875db tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:37.463336 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ec12e1b1-fd22-4988-8658-d59be7f875db tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:37.464923 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ec12e1b1-fd22-4988-8658-d59be7f875db tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:37.465829 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ec12e1b1-fd22-4988-8658-d59be7f875db tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:37.686612 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ec12e1b1-fd22-4988-8658-d59be7f875db tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:37.695554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ec12e1b1-fd22-4988-8658-d59be7f875db tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1553 microversion: 2.1 time: 0.252941 Jun 06 21:05:37.696202 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 52/99] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:37 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1553 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:37.880300 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-eb735e67-d994-4a8f-ba22-04dac21b14cc tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:37.881642 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-eb735e67-d994-4a8f-ba22-04dac21b14cc tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:37.889896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-eb735e67-d994-4a8f-ba22-04dac21b14cc tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:37.890871 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-eb735e67-d994-4a8f-ba22-04dac21b14cc tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:37.891907 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-eb735e67-d994-4a8f-ba22-04dac21b14cc tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:37.892689 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-eb735e67-d994-4a8f-ba22-04dac21b14cc tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:38.081146 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-eb735e67-d994-4a8f-ba22-04dac21b14cc tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:38.093397 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-eb735e67-d994-4a8f-ba22-04dac21b14cc tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:38.095022 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-eb735e67-d994-4a8f-ba22-04dac21b14cc tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:38.101004 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-eb735e67-d994-4a8f-ba22-04dac21b14cc tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1408 microversion: 2.20 time: 0.220380 Jun 06 21:05:38.104089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 48/100] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:05:37 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:05:38.718688 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-28f5712a-58be-4e27-a3c4-8aa4a2390081 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:38.719980 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-28f5712a-58be-4e27-a3c4-8aa4a2390081 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:38.734712 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-28f5712a-58be-4e27-a3c4-8aa4a2390081 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:38.737004 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-28f5712a-58be-4e27-a3c4-8aa4a2390081 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:38.745411 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-28f5712a-58be-4e27-a3c4-8aa4a2390081 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:38.746399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-28f5712a-58be-4e27-a3c4-8aa4a2390081 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:38.957060 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-28f5712a-58be-4e27-a3c4-8aa4a2390081 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:38.969994 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-28f5712a-58be-4e27-a3c4-8aa4a2390081 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1553 microversion: 2.1 time: 0.259351 Jun 06 21:05:38.972522 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 53/101] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:38 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1553 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:39.124244 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-154e73c7-e159-4e78-a4c4-f761e5a2ab53 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:39.126200 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-154e73c7-e159-4e78-a4c4-f761e5a2ab53 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:39.138430 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-154e73c7-e159-4e78-a4c4-f761e5a2ab53 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:39.139774 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-154e73c7-e159-4e78-a4c4-f761e5a2ab53 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:39.141506 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-154e73c7-e159-4e78-a4c4-f761e5a2ab53 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:39.142286 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-154e73c7-e159-4e78-a4c4-f761e5a2ab53 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:39.379876 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-154e73c7-e159-4e78-a4c4-f761e5a2ab53 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:39.395270 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-154e73c7-e159-4e78-a4c4-f761e5a2ab53 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:39.398078 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-154e73c7-e159-4e78-a4c4-f761e5a2ab53 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:39.399972 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-154e73c7-e159-4e78-a4c4-f761e5a2ab53 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1408 microversion: 2.20 time: 0.281922 Jun 06 21:05:39.401596 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 49/102] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:05:39 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1408 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:05:40.000021 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a45bc7c8-8f1d-41d9-a6f5-c5433eb44e0b tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:40.001060 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a45bc7c8-8f1d-41d9-a6f5-c5433eb44e0b tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:40.015308 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a45bc7c8-8f1d-41d9-a6f5-c5433eb44e0b tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:40.016054 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a45bc7c8-8f1d-41d9-a6f5-c5433eb44e0b tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:40.018145 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a45bc7c8-8f1d-41d9-a6f5-c5433eb44e0b tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:40.019212 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a45bc7c8-8f1d-41d9-a6f5-c5433eb44e0b tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:40.300278 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a45bc7c8-8f1d-41d9-a6f5-c5433eb44e0b tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:40.313752 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a45bc7c8-8f1d-41d9-a6f5-c5433eb44e0b tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1553 microversion: 2.1 time: 0.321781 Jun 06 21:05:40.314348 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 54/103] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:39 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1553 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:40.427678 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-1ea874ab-a4c5-4b51-826e-e09ae9fc1f4e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:40.429676 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-1ea874ab-a4c5-4b51-826e-e09ae9fc1f4e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:40.441957 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1ea874ab-a4c5-4b51-826e-e09ae9fc1f4e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:40.443173 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1ea874ab-a4c5-4b51-826e-e09ae9fc1f4e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:40.444916 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1ea874ab-a4c5-4b51-826e-e09ae9fc1f4e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:40.445977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1ea874ab-a4c5-4b51-826e-e09ae9fc1f4e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:40.829826 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-1ea874ab-a4c5-4b51-826e-e09ae9fc1f4e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:40.843414 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-1ea874ab-a4c5-4b51-826e-e09ae9fc1f4e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:40.846811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-1ea874ab-a4c5-4b51-826e-e09ae9fc1f4e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:40.849915 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-1ea874ab-a4c5-4b51-826e-e09ae9fc1f4e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1408 microversion: 2.20 time: 0.428503 Jun 06 21:05:40.851832 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 50/104] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:05:40 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1408 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:05:41.343062 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4ae155af-ebb1-4f6a-943b-4b072cbd0e50 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:41.347041 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4ae155af-ebb1-4f6a-943b-4b072cbd0e50 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:41.358562 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4ae155af-ebb1-4f6a-943b-4b072cbd0e50 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:41.359691 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4ae155af-ebb1-4f6a-943b-4b072cbd0e50 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:41.361487 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4ae155af-ebb1-4f6a-943b-4b072cbd0e50 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:41.362587 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4ae155af-ebb1-4f6a-943b-4b072cbd0e50 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:41.652789 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4ae155af-ebb1-4f6a-943b-4b072cbd0e50 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:41.669844 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4ae155af-ebb1-4f6a-943b-4b072cbd0e50 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1553 microversion: 2.1 time: 0.333629 Jun 06 21:05:41.682070 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 55/105] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:41 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1553 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:41.885471 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-d93334bf-fa7a-4535-b967-01e187ff6f92 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:41.889466 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-d93334bf-fa7a-4535-b967-01e187ff6f92 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:41.904362 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d93334bf-fa7a-4535-b967-01e187ff6f92 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:41.905767 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d93334bf-fa7a-4535-b967-01e187ff6f92 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:41.909543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d93334bf-fa7a-4535-b967-01e187ff6f92 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:41.910554 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d93334bf-fa7a-4535-b967-01e187ff6f92 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:42.332577 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-d93334bf-fa7a-4535-b967-01e187ff6f92 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:42.352571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-d93334bf-fa7a-4535-b967-01e187ff6f92 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:42.355534 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-d93334bf-fa7a-4535-b967-01e187ff6f92 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:42.368032 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-d93334bf-fa7a-4535-b967-01e187ff6f92 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1599 microversion: 2.20 time: 0.481257 Jun 06 21:05:42.369082 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 51/106] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:05:41 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1599 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:05:42.391442 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-80d410c7-20c3-47e6-918a-1e27027ff840 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:42.392593 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-80d410c7-20c3-47e6-918a-1e27027ff840 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:42.400443 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-80d410c7-20c3-47e6-918a-1e27027ff840 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:42.401200 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-80d410c7-20c3-47e6-918a-1e27027ff840 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:42.402169 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-80d410c7-20c3-47e6-918a-1e27027ff840 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:42.402779 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-80d410c7-20c3-47e6-918a-1e27027ff840 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:42.697068 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-796e2e38-461d-4dbf-b868-2244fa9fe4dd tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:42.697810 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-796e2e38-461d-4dbf-b868-2244fa9fe4dd tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:42.718426 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-796e2e38-461d-4dbf-b868-2244fa9fe4dd tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:42.727728 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-796e2e38-461d-4dbf-b868-2244fa9fe4dd tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:42.729732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-796e2e38-461d-4dbf-b868-2244fa9fe4dd tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:42.732866 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-796e2e38-461d-4dbf-b868-2244fa9fe4dd tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:42.762714 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-80d410c7-20c3-47e6-918a-1e27027ff840 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.378804 Jun 06 21:05:42.770425 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 56/107] 10.222.0.33 () {60 vars in 1315 bytes} [Mon Jun 6 21:05:42 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0/os-interface => generated 284 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 21:05:43.997063 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-796e2e38-461d-4dbf-b868-2244fa9fe4dd tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:44.009436 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-796e2e38-461d-4dbf-b868-2244fa9fe4dd tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1553 microversion: 2.1 time: 1.319497 Jun 06 21:05:44.011108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 52/108] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:42 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1553 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:05:44.316226 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-d85a952a-f9c5-42b4-a890-d09083f63337 req-40997b89-f703-4fc4-9747-bd7b92304b6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7aab9b-98d9-4c7b-9155-076474742331", "name": "network-vif-deleted", "tag": "a21aef07-33e5-41f2-8e86-579975d74f4c"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:05:44.329955 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-d85a952a-f9c5-42b4-a890-d09083f63337 req-40997b89-f703-4fc4-9747-bd7b92304b6f service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:44.330689 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-d85a952a-f9c5-42b4-a890-d09083f63337 req-40997b89-f703-4fc4-9747-bd7b92304b6f service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:44.350308 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-d85a952a-f9c5-42b4-a890-d09083f63337 req-40997b89-f703-4fc4-9747-bd7b92304b6f service nova] Creating event network-vif-deleted:a21aef07-33e5-41f2-8e86-579975d74f4c for instance af7aab9b-98d9-4c7b-9155-076474742331 on hv-cinder-84488 Jun 06 21:05:44.357728 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-d85a952a-f9c5-42b4-a890-d09083f63337 req-40997b89-f703-4fc4-9747-bd7b92304b6f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046607 Jun 06 21:05:44.358970 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 57/109] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:05:45.046137 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-82075efa-0686-4241-bddf-4769287a8f26 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:45.047104 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-82075efa-0686-4241-bddf-4769287a8f26 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:45.051415 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-4e5db8a3-d28d-40bf-b2fa-2de59332f30f req-32ed762d-3c14-4a9e-8ce8-6f862def8380 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1886e3bf-c735-4f91-8a2f-0bc6996982e0", "tag": "2e4dc91b-9fa1-4ca1-9827-0ca3ef02a18e"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:05:45.070266 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-82075efa-0686-4241-bddf-4769287a8f26 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:45.071566 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-82075efa-0686-4241-bddf-4769287a8f26 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:45.073561 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-82075efa-0686-4241-bddf-4769287a8f26 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:45.075522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-82075efa-0686-4241-bddf-4769287a8f26 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:45.083693 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-4e5db8a3-d28d-40bf-b2fa-2de59332f30f req-32ed762d-3c14-4a9e-8ce8-6f862def8380 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:45.084903 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-4e5db8a3-d28d-40bf-b2fa-2de59332f30f req-32ed762d-3c14-4a9e-8ce8-6f862def8380 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:45.115863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:05:45.123459 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-4e5db8a3-d28d-40bf-b2fa-2de59332f30f req-32ed762d-3c14-4a9e-8ce8-6f862def8380 service nova] Creating event network-changed:2e4dc91b-9fa1-4ca1-9827-0ca3ef02a18e for instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 on hv-cinder-84488 Jun 06 21:05:45.147250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-4e5db8a3-d28d-40bf-b2fa-2de59332f30f req-32ed762d-3c14-4a9e-8ce8-6f862def8380 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098356 Jun 06 21:05:45.150626 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 58/110] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:05:45.219301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-82075efa-0686-4241-bddf-4769287a8f26 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:45.235074 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-82075efa-0686-4241-bddf-4769287a8f26 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1345 microversion: 2.1 time: 0.200712 Jun 06 21:05:45.236120 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 53/111] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:45 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1345 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:46.267872 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7b21f395-1ee0-45b4-bd58-0d1c6e4f1c63 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:46.269599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7b21f395-1ee0-45b4-bd58-0d1c6e4f1c63 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:46.327588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7b21f395-1ee0-45b4-bd58-0d1c6e4f1c63 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:46.328079 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7b21f395-1ee0-45b4-bd58-0d1c6e4f1c63 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:46.328902 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7b21f395-1ee0-45b4-bd58-0d1c6e4f1c63 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:46.329667 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7b21f395-1ee0-45b4-bd58-0d1c6e4f1c63 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:46.608034 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7b21f395-1ee0-45b4-bd58-0d1c6e4f1c63 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:46.624238 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7b21f395-1ee0-45b4-bd58-0d1c6e4f1c63 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1345 microversion: 2.1 time: 0.362458 Jun 06 21:05:46.626821 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 59/112] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:46 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1345 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:05:47.644920 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-aafb8f4a-f7cf-49a1-8919-d19d7f520d64 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:47.647236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-aafb8f4a-f7cf-49a1-8919-d19d7f520d64 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:47.674668 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-aafb8f4a-f7cf-49a1-8919-d19d7f520d64 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:47.677481 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-aafb8f4a-f7cf-49a1-8919-d19d7f520d64 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:47.685739 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-aafb8f4a-f7cf-49a1-8919-d19d7f520d64 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:47.687117 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-aafb8f4a-f7cf-49a1-8919-d19d7f520d64 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:47.789701 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-aafb8f4a-f7cf-49a1-8919-d19d7f520d64 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:47.790638 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-aafb8f4a-f7cf-49a1-8919-d19d7f520d64 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:47.793073 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.objects.instance [None req-aafb8f4a-f7cf-49a1-8919-d19d7f520d64 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lazy-loading 'fault' on Instance uuid af7aab9b-98d9-4c7b-9155-076474742331 {{(pid=117860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:05:47.915320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-aafb8f4a-f7cf-49a1-8919-d19d7f520d64 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d92849843e49e7833f03ca38cb8367', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd447d1ebbf403bbf62efc88834bdca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:47.937587 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-aafb8f4a-f7cf-49a1-8919-d19d7f520d64 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 200 len: 1304 microversion: 2.1 time: 0.298284 Jun 06 21:05:47.944554 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 54/113] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:47 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 1304 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:48.978621 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fea9de57-22ea-4a6d-b655-503eb12d2ede tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:48.979756 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fea9de57-22ea-4a6d-b655-503eb12d2ede tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:48.991777 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fea9de57-22ea-4a6d-b655-503eb12d2ede tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:48.993046 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fea9de57-22ea-4a6d-b655-503eb12d2ede tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:48.994655 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fea9de57-22ea-4a6d-b655-503eb12d2ede tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:48.995694 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fea9de57-22ea-4a6d-b655-503eb12d2ede tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:49.026836 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-fea9de57-22ea-4a6d-b655-503eb12d2ede tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] HTTP exception thrown: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. Jun 06 21:05:49.049440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fea9de57-22ea-4a6d-b655-503eb12d2ede tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Request method failure captured: Jun 06 21:05:49.049440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 HTTP/1.1 Jun 06 21:05:49.049440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:05:49.049440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:05:49.049440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:05:49.049440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:05:49.049440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:05:49.049440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:05:49.049440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:05:49.049440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:05:49.049440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinmviJar554KYGQ30fmxPLYwpllEzCc3TjDbNmPZp5UmwRpJqwfkJTZ7z71a0QDklldz6MlupqIYZlGL07MLwvO0Z1oIvLj4rwc9nW2alr5d_dg7ZmQc_RXC1zfQORLucjh6Ly--5Er3Z43di7Fd-cr7vJH-0mVOEURLSA3kNbQ01gm0 Jun 06 21:05:49.049440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:05:49.049440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:05:49.049440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:05:49.049440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:05:49.049440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:05:49.049440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:05:49.049440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: cdd447d1ebbf403bbf62efc88834bdca Jun 06 21:05:49.049440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-DeleteServersTestJSON-172034061 Jun 06 21:05:49.049440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:05:49.049440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:05:49.051887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cdd447d1ebbf403bbf62efc88834bdca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cdd447d1ebbf403bbf62efc88834bdca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cdd447d1ebbf403bbf62efc88834bdca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cdd447d1ebbf403bbf62efc88834bdca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:05:49.051887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-DeleteServersTestJSON-172034061 Jun 06 21:05:49.051887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: cdd447d1ebbf403bbf62efc88834bdca Jun 06 21:05:49.051887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-DeleteServersTestJSON-172034061 Jun 06 21:05:49.051887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-DeleteServersTestJSON-172034061-project Jun 06 21:05:49.051887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:05:49.051887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:05:49.051887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: 39d92849843e49e7833f03ca38cb8367 Jun 06 21:05:49.051887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-DeleteServersTestJSON-172034061-project Jun 06 21:05:49.051887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: > Jun 06 21:05:49.051887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. Jun 06 21:05:49.051887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': 'af7aab9b-98d9-4c7b-9155-076474742331'} Jun 06 21:05:49.054351 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:05:49.054351 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:05:49.054351 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:05:49.054351 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:05:49.054351 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:05:49.054351 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:05:49.054351 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:05:49.054351 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:05:49.054351 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:05:49.054351 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:05:49.054351 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. Jun 06 21:05:49.054351 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:05:49.054351 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:05:49.054351 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:05:49.054351 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:05:49.054351 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:05:49.054351 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:05:49.054351 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:05:49.054351 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:05:49.054351 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:05:49.058654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:05:49.058654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:05:49.058654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:05:49.058654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:05:49.058654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:05:49.058654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:05:49.058654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:05:49.058654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. Jun 06 21:05:49.058654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:05:49.058654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:05:49.058654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:05:49.058654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:05:49.058654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:05:49.058654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:05:49.058654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:05:49.058654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:05:49.058654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. Jun 06 21:05:49.058654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:05:49.068992 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fea9de57-22ea-4a6d-b655-503eb12d2ede tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Returning 404 to user: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:05:49.068992 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fea9de57-22ea-4a6d-b655-503eb12d2ede tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 404 len: 111 microversion: 2.1 time: 0.087350 Jun 06 21:05:49.068992 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 60/114] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:48 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:05:49.267299 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-3c8a3940-e140-4815-b9b5-7f9a592ba023 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:49.269140 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-3c8a3940-e140-4815-b9b5-7f9a592ba023 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:49.276927 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3c8a3940-e140-4815-b9b5-7f9a592ba023 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:49.277358 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3c8a3940-e140-4815-b9b5-7f9a592ba023 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:49.278481 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3c8a3940-e140-4815-b9b5-7f9a592ba023 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:49.279388 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3c8a3940-e140-4815-b9b5-7f9a592ba023 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:49.305628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-3c8a3940-e140-4815-b9b5-7f9a592ba023 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] HTTP exception thrown: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. Jun 06 21:05:49.313576 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-3c8a3940-e140-4815-b9b5-7f9a592ba023 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Request method failure captured: Jun 06 21:05:49.313576 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331/os-volume_attachments HTTP/1.1 Jun 06 21:05:49.313576 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:05:49.313576 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:05:49.313576 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:05:49.313576 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 0 Jun 06 21:05:49.313576 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:05:49.313576 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:05:49.313576 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:05:49.313576 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:05:49.313576 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinmviJar554KYGQ30fmxPLYwpllEzCc3TjDbNmPZp5UmwRpJqwfkJTZ7z71a0QDklldz6MlupqIYZlGL07MLwvO0Z1oIvLj4rwc9nW2alr5d_dg7ZmQc_RXC1zfQORLucjh6Ly--5Er3Z43di7Fd-cr7vJH-0mVOEURLSA3kNbQ01gm0 Jun 06 21:05:49.313576 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:05:49.313576 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:05:49.313576 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:05:49.313576 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:05:49.313576 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:05:49.313576 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:05:49.313576 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: cdd447d1ebbf403bbf62efc88834bdca Jun 06 21:05:49.313576 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-DeleteServersTestJSON-172034061 Jun 06 21:05:49.313576 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:05:49.313576 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:05:49.315660 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cdd447d1ebbf403bbf62efc88834bdca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cdd447d1ebbf403bbf62efc88834bdca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cdd447d1ebbf403bbf62efc88834bdca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cdd447d1ebbf403bbf62efc88834bdca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:05:49.315660 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-DeleteServersTestJSON-172034061 Jun 06 21:05:49.315660 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: cdd447d1ebbf403bbf62efc88834bdca Jun 06 21:05:49.315660 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-DeleteServersTestJSON-172034061 Jun 06 21:05:49.315660 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-DeleteServersTestJSON-172034061-project Jun 06 21:05:49.315660 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:05:49.315660 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:05:49.315660 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: 39d92849843e49e7833f03ca38cb8367 Jun 06 21:05:49.315660 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-DeleteServersTestJSON-172034061-project Jun 06 21:05:49.315660 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: > Jun 06 21:05:49.315660 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. Jun 06 21:05:49.315660 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'server_id': 'af7aab9b-98d9-4c7b-9155-076474742331'} Jun 06 21:05:49.316944 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:05:49.316944 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:05:49.316944 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:05:49.316944 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:05:49.316944 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:05:49.316944 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:05:49.316944 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:05:49.316944 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:05:49.316944 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:05:49.316944 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:05:49.316944 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. Jun 06 21:05:49.316944 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:05:49.316944 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:05:49.316944 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:05:49.316944 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:05:49.316944 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:05:49.316944 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:05:49.316944 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:05:49.316944 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:05:49.316944 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:05:49.319977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:05:49.319977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 06 21:05:49.319977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 21:05:49.319977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 06 21:05:49.319977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 21:05:49.319977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 06 21:05:49.319977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 06 21:05:49.319977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:05:49.319977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:05:49.319977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. Jun 06 21:05:49.319977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:05:49.319977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:05:49.319977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:05:49.319977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:05:49.319977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:05:49.319977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:05:49.319977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:05:49.319977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:05:49.319977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. Jun 06 21:05:49.319977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:05:49.324307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-3c8a3940-e140-4815-b9b5-7f9a592ba023 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Returning 404 to user: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:05:49.324307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-3c8a3940-e140-4815-b9b5-7f9a592ba023 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.061429 Jun 06 21:05:49.326344 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 55/115] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 6 21:05:49 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331/os-volume_attachments => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:05:52.073380 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a85675b0-7d5e-4d55-bc9c-cf959f32b14b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1603208728", "imageRef": "e4266a01-7d22-4036-91e8-3ec50e3369c1", "flavorRef": "452", "networks": [{"uuid": "d022549a-4a85-4392-8e6a-5d4d29f676e1"}]}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:05:52.165173 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-a85675b0-7d5e-4d55-bc9c-cf959f32b14b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] validate_networks() for [('d022549a-4a85-4392-8e6a-5d4d29f676e1', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 21:05:52.764696 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-a85675b0-7d5e-4d55-bc9c-cf959f32b14b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 21:05:52.765237 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-a85675b0-7d5e-4d55-bc9c-cf959f32b14b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 21:05:52.766308 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-a85675b0-7d5e-4d55-bc9c-cf959f32b14b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 21:05:52.767098 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-a85675b0-7d5e-4d55-bc9c-cf959f32b14b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 21:05:52.767809 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-a85675b0-7d5e-4d55-bc9c-cf959f32b14b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 21:05:52.782395 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a85675b0-7d5e-4d55-bc9c-cf959f32b14b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:52.782998 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a85675b0-7d5e-4d55-bc9c-cf959f32b14b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:52.784293 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a85675b0-7d5e-4d55-bc9c-cf959f32b14b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:52.784728 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a85675b0-7d5e-4d55-bc9c-cf959f32b14b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:52.797030 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-9c54f8f9-50d4-40aa-8ae0-4430ffc92f28 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:52.797775 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-9c54f8f9-50d4-40aa-8ae0-4430ffc92f28 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:52.805299 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9c54f8f9-50d4-40aa-8ae0-4430ffc92f28 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:52.805744 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9c54f8f9-50d4-40aa-8ae0-4430ffc92f28 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:52.806523 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9c54f8f9-50d4-40aa-8ae0-4430ffc92f28 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:52.806991 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9c54f8f9-50d4-40aa-8ae0-4430ffc92f28 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:52.809327 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-a85675b0-7d5e-4d55-bc9c-cf959f32b14b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Getting quotas for project f1a72d23da2148c598c119821ec8a513. Resources: {'ram', 'cores', 'instances'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:05:52.815700 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-a85675b0-7d5e-4d55-bc9c-cf959f32b14b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Getting quotas for user 101810e54c274bf48c3cab586d24e764 and project f1a72d23da2148c598c119821ec8a513. Resources: {'ram', 'cores', 'instances'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:05:52.822749 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-9c54f8f9-50d4-40aa-8ae0-4430ffc92f28 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] HTTP exception thrown: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. Jun 06 21:05:52.825406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-9c54f8f9-50d4-40aa-8ae0-4430ffc92f28 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Request method failure captured: Jun 06 21:05:52.825406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: DELETE /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 HTTP/1.1 Jun 06 21:05:52.825406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:05:52.825406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:05:52.825406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:05:52.825406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 0 Jun 06 21:05:52.825406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:05:52.825406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:05:52.825406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:05:52.825406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:05:52.825406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinmviJar554KYGQ30fmxPLYwpllEzCc3TjDbNmPZp5UmwRpJqwfkJTZ7z71a0QDklldz6MlupqIYZlGL07MLwvO0Z1oIvLj4rwc9nW2alr5d_dg7ZmQc_RXC1zfQORLucjh6Ly--5Er3Z43di7Fd-cr7vJH-0mVOEURLSA3kNbQ01gm0 Jun 06 21:05:52.825406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:05:52.825406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:05:52.825406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:05:52.825406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:05:52.825406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:05:52.825406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:05:52.825406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: cdd447d1ebbf403bbf62efc88834bdca Jun 06 21:05:52.825406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-DeleteServersTestJSON-172034061 Jun 06 21:05:52.825406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:05:52.825406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:05:52.826767 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cdd447d1ebbf403bbf62efc88834bdca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cdd447d1ebbf403bbf62efc88834bdca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cdd447d1ebbf403bbf62efc88834bdca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cdd447d1ebbf403bbf62efc88834bdca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:05:52.826767 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-DeleteServersTestJSON-172034061 Jun 06 21:05:52.826767 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: cdd447d1ebbf403bbf62efc88834bdca Jun 06 21:05:52.826767 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-DeleteServersTestJSON-172034061 Jun 06 21:05:52.826767 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-DeleteServersTestJSON-172034061-project Jun 06 21:05:52.826767 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:05:52.826767 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:05:52.826767 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: 39d92849843e49e7833f03ca38cb8367 Jun 06 21:05:52.826767 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-DeleteServersTestJSON-172034061-project Jun 06 21:05:52.826767 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: > Jun 06 21:05:52.826767 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. Jun 06 21:05:52.826767 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'id': 'af7aab9b-98d9-4c7b-9155-076474742331'} Jun 06 21:05:52.827560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:05:52.827560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:05:52.827560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:05:52.827560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:05:52.827560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:05:52.827560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:05:52.827560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:05:52.827560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:05:52.827560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:05:52.827560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:05:52.827560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. Jun 06 21:05:52.827560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:05:52.827560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:05:52.827560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:05:52.827560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:05:52.827560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:05:52.827560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:05:52.827560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:05:52.827560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:05:52.827560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:05:52.829089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:05:52.829089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 21:05:52.829089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 21:05:52.829089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 21:05:52.829089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 21:05:52.829089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:05:52.829089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:05:52.829089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:05:52.829089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:05:52.829089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. Jun 06 21:05:52.829089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:05:52.829089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:05:52.829089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:05:52.829089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:05:52.829089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:05:52.829089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:05:52.829089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:05:52.829089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:05:52.829089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. Jun 06 21:05:52.829089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:05:52.830711 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a85675b0-7d5e-4d55-bc9c-cf959f32b14b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 21:05:52.831810 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-9c54f8f9-50d4-40aa-8ae0-4430ffc92f28 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Returning 404 to user: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:05:52.832796 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-9c54f8f9-50d4-40aa-8ae0-4430ffc92f28 tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "DELETE /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 404 len: 111 microversion: 2.1 time: 0.044681 Jun 06 21:05:52.833446 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 56/116] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:05:52 2022] DELETE /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:05:52.833685 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a85675b0-7d5e-4d55-bc9c-cf959f32b14b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4266a01-7d22-4036-91e8-3ec50e3369c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 21:05:52.843377 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0d5bc574-812b-4895-9fa7-144288a4cdbf tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:52.844023 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-0d5bc574-812b-4895-9fa7-144288a4cdbf tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] [instance: af7aab9b-98d9-4c7b-9155-076474742331] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:52.850730 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0d5bc574-812b-4895-9fa7-144288a4cdbf tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:52.851178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0d5bc574-812b-4895-9fa7-144288a4cdbf tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:52.852023 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0d5bc574-812b-4895-9fa7-144288a4cdbf tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:52.852624 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0d5bc574-812b-4895-9fa7-144288a4cdbf tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:52.868453 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-0d5bc574-812b-4895-9fa7-144288a4cdbf tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] HTTP exception thrown: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. Jun 06 21:05:52.870005 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0d5bc574-812b-4895-9fa7-144288a4cdbf tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Request method failure captured: Jun 06 21:05:52.870005 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 HTTP/1.1 Jun 06 21:05:52.870005 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:05:52.870005 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:05:52.870005 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:05:52.870005 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 0 Jun 06 21:05:52.870005 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:05:52.870005 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:05:52.870005 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:05:52.870005 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:05:52.870005 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinmviJar554KYGQ30fmxPLYwpllEzCc3TjDbNmPZp5UmwRpJqwfkJTZ7z71a0QDklldz6MlupqIYZlGL07MLwvO0Z1oIvLj4rwc9nW2alr5d_dg7ZmQc_RXC1zfQORLucjh6Ly--5Er3Z43di7Fd-cr7vJH-0mVOEURLSA3kNbQ01gm0 Jun 06 21:05:52.870005 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:05:52.870005 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:05:52.870005 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:05:52.870005 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:05:52.870005 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:05:52.870005 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:05:52.870005 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: cdd447d1ebbf403bbf62efc88834bdca Jun 06 21:05:52.870005 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-DeleteServersTestJSON-172034061 Jun 06 21:05:52.870005 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:05:52.870005 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:05:52.871397 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cdd447d1ebbf403bbf62efc88834bdca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_cdd447d1ebbf403bbf62efc88834bdca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/cdd447d1ebbf403bbf62efc88834bdca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/cdd447d1ebbf403bbf62efc88834bdca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:05:52.871397 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-DeleteServersTestJSON-172034061 Jun 06 21:05:52.871397 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: cdd447d1ebbf403bbf62efc88834bdca Jun 06 21:05:52.871397 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-DeleteServersTestJSON-172034061 Jun 06 21:05:52.871397 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-DeleteServersTestJSON-172034061-project Jun 06 21:05:52.871397 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:05:52.871397 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:05:52.871397 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: 39d92849843e49e7833f03ca38cb8367 Jun 06 21:05:52.871397 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-DeleteServersTestJSON-172034061-project Jun 06 21:05:52.871397 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: > Jun 06 21:05:52.871397 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. Jun 06 21:05:52.871397 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'id': 'af7aab9b-98d9-4c7b-9155-076474742331'} Jun 06 21:05:52.872526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:05:52.872526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:05:52.872526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:05:52.872526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:05:52.872526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:05:52.872526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:05:52.872526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:05:52.872526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:05:52.872526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:05:52.872526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:05:52.872526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. Jun 06 21:05:52.872526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:05:52.872526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:05:52.872526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:05:52.872526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:05:52.872526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:05:52.872526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:05:52.872526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:05:52.872526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:05:52.872526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:05:52.874015 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:05:52.874015 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:05:52.874015 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:05:52.874015 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:05:52.874015 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:05:52.874015 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:05:52.874015 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:05:52.874015 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. Jun 06 21:05:52.874015 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:05:52.874015 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:05:52.874015 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:05:52.874015 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:05:52.874015 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:05:52.874015 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:05:52.874015 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:05:52.874015 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:05:52.874015 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. Jun 06 21:05:52.874015 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:05:52.875499 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0d5bc574-812b-4895-9fa7-144288a4cdbf tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] Returning 404 to user: Instance af7aab9b-98d9-4c7b-9155-076474742331 could not be found. {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:05:52.875499 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-0d5bc574-812b-4895-9fa7-144288a4cdbf tempest-DeleteServersTestJSON-172034061 tempest-DeleteServersTestJSON-172034061-project] 10.222.0.33 "GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331" status: 404 len: 111 microversion: 2.1 time: 0.032743 Jun 06 21:05:52.875499 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 57/117] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:52 2022] GET /compute/v2.1/servers/af7aab9b-98d9-4c7b-9155-076474742331 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 21:05:52.897736 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a85675b0-7d5e-4d55-bc9c-cf959f32b14b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.833472 Jun 06 21:05:52.898881 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 61/118] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 6 21:05:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 836 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 21:05:52.913069 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b95c0de6-77ae-4bae-9b90-840921a32ddc tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:52.913704 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-b95c0de6-77ae-4bae-9b90-840921a32ddc tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:52.994935 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-b95c0de6-77ae-4bae-9b90-840921a32ddc tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:53.003375 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-b95c0de6-77ae-4bae-9b90-840921a32ddc tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1214 microversion: 2.1 time: 0.096809 Jun 06 21:05:53.004239 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 58/119] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:52 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:54.022962 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8477ff2b-bf1e-4e5e-acc6-38d537b730b4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:54.024285 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8477ff2b-bf1e-4e5e-acc6-38d537b730b4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:54.036749 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8477ff2b-bf1e-4e5e-acc6-38d537b730b4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:54.036749 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8477ff2b-bf1e-4e5e-acc6-38d537b730b4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:54.037713 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8477ff2b-bf1e-4e5e-acc6-38d537b730b4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:54.038152 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8477ff2b-bf1e-4e5e-acc6-38d537b730b4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:54.115691 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8477ff2b-bf1e-4e5e-acc6-38d537b730b4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:54.126861 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8477ff2b-bf1e-4e5e-acc6-38d537b730b4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1218 microversion: 2.1 time: 0.108743 Jun 06 21:05:54.128948 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 62/120] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:54 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:05:55.150238 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-7d552137-2f1e-401e-9f5a-b1dae1d37e41 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:55.151959 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-7d552137-2f1e-401e-9f5a-b1dae1d37e41 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:55.165072 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7d552137-2f1e-401e-9f5a-b1dae1d37e41 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:55.165518 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7d552137-2f1e-401e-9f5a-b1dae1d37e41 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:55.166377 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7d552137-2f1e-401e-9f5a-b1dae1d37e41 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:55.166808 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7d552137-2f1e-401e-9f5a-b1dae1d37e41 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:55.243600 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-7d552137-2f1e-401e-9f5a-b1dae1d37e41 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:55.264360 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-7d552137-2f1e-401e-9f5a-b1dae1d37e41 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1210 microversion: 2.1 time: 0.122066 Jun 06 21:05:55.266553 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 59/121] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:55 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1210 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:56.287607 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-da888f01-25e3-476e-857d-3dc1aa504e18 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:56.289217 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-da888f01-25e3-476e-857d-3dc1aa504e18 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:56.301046 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-da888f01-25e3-476e-857d-3dc1aa504e18 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:56.301823 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-da888f01-25e3-476e-857d-3dc1aa504e18 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:56.303231 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-da888f01-25e3-476e-857d-3dc1aa504e18 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:56.304030 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-da888f01-25e3-476e-857d-3dc1aa504e18 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:56.421865 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-da888f01-25e3-476e-857d-3dc1aa504e18 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:56.440513 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-da888f01-25e3-476e-857d-3dc1aa504e18 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1266 microversion: 2.1 time: 0.160528 Jun 06 21:05:56.442711 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 63/122] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:56 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:57.469790 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-281f57a5-14ac-495f-adba-dec6f911d128 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:57.469790 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-281f57a5-14ac-495f-adba-dec6f911d128 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:57.477946 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-281f57a5-14ac-495f-adba-dec6f911d128 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:57.478475 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-281f57a5-14ac-495f-adba-dec6f911d128 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:57.479336 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-281f57a5-14ac-495f-adba-dec6f911d128 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:57.480014 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-281f57a5-14ac-495f-adba-dec6f911d128 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:57.580509 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-281f57a5-14ac-495f-adba-dec6f911d128 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:57.588965 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-281f57a5-14ac-495f-adba-dec6f911d128 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1266 microversion: 2.1 time: 0.124148 Jun 06 21:05:57.589578 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 60/123] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:57 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1266 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:58.610748 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-847437dc-8bb4-4a21-80cb-07b3f21d1d05 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:58.614865 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-847437dc-8bb4-4a21-80cb-07b3f21d1d05 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:58.620875 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-847437dc-8bb4-4a21-80cb-07b3f21d1d05 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:58.621650 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-847437dc-8bb4-4a21-80cb-07b3f21d1d05 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:58.622970 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-847437dc-8bb4-4a21-80cb-07b3f21d1d05 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:58.623776 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-847437dc-8bb4-4a21-80cb-07b3f21d1d05 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:58.722692 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-847437dc-8bb4-4a21-80cb-07b3f21d1d05 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:05:58.735844 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-847437dc-8bb4-4a21-80cb-07b3f21d1d05 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1266 microversion: 2.1 time: 0.129701 Jun 06 21:05:58.736500 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 64/124] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:58 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:05:59.754530 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-c2dda29b-808b-4f10-afcd-012ce16c6c3a tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:05:59.755611 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-c2dda29b-808b-4f10-afcd-012ce16c6c3a tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:05:59.763871 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c2dda29b-808b-4f10-afcd-012ce16c6c3a tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:59.765750 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c2dda29b-808b-4f10-afcd-012ce16c6c3a tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:05:59.768758 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c2dda29b-808b-4f10-afcd-012ce16c6c3a tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:05:59.769478 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c2dda29b-808b-4f10-afcd-012ce16c6c3a tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:00.063798 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c2dda29b-808b-4f10-afcd-012ce16c6c3a tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:00.092995 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-c2dda29b-808b-4f10-afcd-012ce16c6c3a tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1314 microversion: 2.1 time: 0.342835 Jun 06 21:06:00.094376 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 61/125] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:05:59 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:01.110901 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fd543056-2840-469d-95ff-02032c86d7af tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:01.111573 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fd543056-2840-469d-95ff-02032c86d7af tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:01.120975 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fd543056-2840-469d-95ff-02032c86d7af tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:01.121874 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fd543056-2840-469d-95ff-02032c86d7af tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:01.123340 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fd543056-2840-469d-95ff-02032c86d7af tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:01.124186 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fd543056-2840-469d-95ff-02032c86d7af tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:01.144399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=84 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:01.318274 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fd543056-2840-469d-95ff-02032c86d7af tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:01.328731 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fd543056-2840-469d-95ff-02032c86d7af tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1314 microversion: 2.1 time: 0.221738 Jun 06 21:06:01.329776 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 65/126] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:01 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:01.366750 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-c816c2bf-658f-4080-b870-2d4060360e65 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1810695416", "imageRef": "e4266a01-7d22-4036-91e8-3ec50e3369c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:06:01.443600 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.network.neutron [None req-c816c2bf-658f-4080-b870-2d4060360e65 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] validate_networks() for [('9bdfa114-ca93-4485-b7b6-8e22817f3380', None, None, None, None, None)] {{(pid=117860) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 21:06:02.237686 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-c816c2bf-658f-4080-b870-2d4060360e65 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Flavor limits 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 21:06:02.238379 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-c816c2bf-658f-4080-b870-2d4060360e65 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Image limits 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 21:06:02.239028 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-c816c2bf-658f-4080-b870-2d4060360e65 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Flavor pref 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 21:06:02.239429 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-c816c2bf-658f-4080-b870-2d4060360e65 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Image pref 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 21:06:02.240103 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-c816c2bf-658f-4080-b870-2d4060360e65 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 21:06:02.253883 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c816c2bf-658f-4080-b870-2d4060360e65 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:02.254404 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c816c2bf-658f-4080-b870-2d4060360e65 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:02.255288 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c816c2bf-658f-4080-b870-2d4060360e65 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:02.255715 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c816c2bf-658f-4080-b870-2d4060360e65 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:02.274861 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-c816c2bf-658f-4080-b870-2d4060360e65 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Getting quotas for project f0246519bc2240cf8d1ba54172c0faca. Resources: {'ram', 'cores', 'instances'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:06:02.279271 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-c816c2bf-658f-4080-b870-2d4060360e65 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Getting quotas for user ab9da673f40b4e3eb541fdc380cfe282 and project f0246519bc2240cf8d1ba54172c0faca. Resources: {'ram', 'cores', 'instances'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:06:02.292399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-c816c2bf-658f-4080-b870-2d4060360e65 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Going to run 1 instances... {{(pid=117860) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 21:06:02.295489 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-c816c2bf-658f-4080-b870-2d4060360e65 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4266a01-7d22-4036-91e8-3ec50e3369c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 21:06:02.348412 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-25917c78-8038-4bc0-b4cf-9615be878278 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:02.349127 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-25917c78-8038-4bc0-b4cf-9615be878278 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:02.356783 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-25917c78-8038-4bc0-b4cf-9615be878278 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:02.357453 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-25917c78-8038-4bc0-b4cf-9615be878278 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:02.358316 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-25917c78-8038-4bc0-b4cf-9615be878278 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:02.359031 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-25917c78-8038-4bc0-b4cf-9615be878278 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:02.430229 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-c816c2bf-658f-4080-b870-2d4060360e65 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.219392 Jun 06 21:06:02.431034 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 62/127] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 6 21:06:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 06 21:06:02.443302 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-d8b79e81-2311-4f0b-bc34-82b29068e66d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:02.443703 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-d8b79e81-2311-4f0b-bc34-82b29068e66d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:02.527537 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-d8b79e81-2311-4f0b-bc34-82b29068e66d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:02.544365 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-d8b79e81-2311-4f0b-bc34-82b29068e66d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1222 microversion: 2.1 time: 0.105570 Jun 06 21:06:02.545989 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 63/128] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:02 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1222 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:02.655024 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-5f68811e-69bc-4270-b2f3-410c09ace8e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1127435606", "imageRef": "e4266a01-7d22-4036-91e8-3ec50e3369c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:06:02.740941 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.network.neutron [None req-5f68811e-69bc-4270-b2f3-410c09ace8e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] validate_networks() for [('9bdfa114-ca93-4485-b7b6-8e22817f3380', None, None, None, None, None)] {{(pid=117860) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 21:06:02.765469 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-25917c78-8038-4bc0-b4cf-9615be878278 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:02.781345 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-25917c78-8038-4bc0-b4cf-9615be878278 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1314 microversion: 2.1 time: 0.436954 Jun 06 21:06:02.795532 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 66/129] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:02 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:02.946898 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:02.948491 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=6 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:02.955983 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-dcbdfd5e-b2a7-48a2-ab69-1dee574e3b9e req-8128b4d8-d823-4549-997d-0feee18837bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f03e0091-74a5-4481-8832-6c3c63a05513", "tag": "7365f89f-bf7b-41fa-b1b6-79e6861ba5fc"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:06:02.978995 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-dcbdfd5e-b2a7-48a2-ab69-1dee574e3b9e req-8128b4d8-d823-4549-997d-0feee18837bc service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:02.980736 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-dcbdfd5e-b2a7-48a2-ab69-1dee574e3b9e req-8128b4d8-d823-4549-997d-0feee18837bc service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:03.020532 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-dcbdfd5e-b2a7-48a2-ab69-1dee574e3b9e req-8128b4d8-d823-4549-997d-0feee18837bc service nova] Creating event network-changed:7365f89f-bf7b-41fa-b1b6-79e6861ba5fc for instance f03e0091-74a5-4481-8832-6c3c63a05513 on hv-cinder-84488 Jun 06 21:06:03.037780 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-dcbdfd5e-b2a7-48a2-ab69-1dee574e3b9e req-8128b4d8-d823-4549-997d-0feee18837bc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089026 Jun 06 21:06:03.043092 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 67/130] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:06:03.802183 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5fcc470e-53c0-4dbc-8fab-9b60f1b2ffaa tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:03.803439 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5fcc470e-53c0-4dbc-8fab-9b60f1b2ffaa tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:03.822596 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-5f68811e-69bc-4270-b2f3-410c09ace8e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Flavor limits 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 21:06:03.823182 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-5f68811e-69bc-4270-b2f3-410c09ace8e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Image limits 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 21:06:03.823771 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-5f68811e-69bc-4270-b2f3-410c09ace8e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Flavor pref 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 21:06:03.825068 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-5f68811e-69bc-4270-b2f3-410c09ace8e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Image pref 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 21:06:03.825767 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-5f68811e-69bc-4270-b2f3-410c09ace8e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 21:06:03.828240 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5fcc470e-53c0-4dbc-8fab-9b60f1b2ffaa tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:03.828455 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:03.828840 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5fcc470e-53c0-4dbc-8fab-9b60f1b2ffaa tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:03.832754 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5fcc470e-53c0-4dbc-8fab-9b60f1b2ffaa tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:03.833307 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5fcc470e-53c0-4dbc-8fab-9b60f1b2ffaa tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:03.849651 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5f68811e-69bc-4270-b2f3-410c09ace8e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:03.851626 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5f68811e-69bc-4270-b2f3-410c09ace8e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:03.853272 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5f68811e-69bc-4270-b2f3-410c09ace8e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:03.853974 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5f68811e-69bc-4270-b2f3-410c09ace8e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:03.880925 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-5f68811e-69bc-4270-b2f3-410c09ace8e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Getting quotas for project f0246519bc2240cf8d1ba54172c0faca. Resources: {'ram', 'cores', 'instances'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:06:03.886644 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-5f68811e-69bc-4270-b2f3-410c09ace8e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Getting quotas for user ab9da673f40b4e3eb541fdc380cfe282 and project f0246519bc2240cf8d1ba54172c0faca. Resources: {'ram', 'cores', 'instances'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:06:03.902567 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-5f68811e-69bc-4270-b2f3-410c09ace8e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Going to run 1 instances... {{(pid=117860) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 21:06:03.906149 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-5f68811e-69bc-4270-b2f3-410c09ace8e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4266a01-7d22-4036-91e8-3ec50e3369c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 21:06:03.972802 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-5f68811e-69bc-4270-b2f3-410c09ace8e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.326117 Jun 06 21:06:03.974239 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 64/131] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 6 21:06:02 2022] POST /compute/v2.1/servers => generated 383 bytes in 1329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 06 21:06:03.988986 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-6f45ab60-3d41-4d77-83f5-48ae81b8b631 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:03.991944 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-6f45ab60-3d41-4d77-83f5-48ae81b8b631 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:04.078408 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-6f45ab60-3d41-4d77-83f5-48ae81b8b631 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:04.088373 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-6f45ab60-3d41-4d77-83f5-48ae81b8b631 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1222 microversion: 2.1 time: 0.105899 Jun 06 21:06:04.089422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 65/132] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:03 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1222 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:04.245938 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5fcc470e-53c0-4dbc-8fab-9b60f1b2ffaa tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:04.255725 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5fcc470e-53c0-4dbc-8fab-9b60f1b2ffaa tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1314 microversion: 2.1 time: 0.459519 Jun 06 21:06:04.261027 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 68/133] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:03 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:06:05.115649 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-1e29177c-f9c6-449d-ae9a-02f81c673043 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:05.116822 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-1e29177c-f9c6-449d-ae9a-02f81c673043 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:05.127273 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1e29177c-f9c6-449d-ae9a-02f81c673043 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:05.128419 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1e29177c-f9c6-449d-ae9a-02f81c673043 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:05.129723 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1e29177c-f9c6-449d-ae9a-02f81c673043 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:05.130537 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1e29177c-f9c6-449d-ae9a-02f81c673043 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:05.217832 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-1e29177c-f9c6-449d-ae9a-02f81c673043 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:05.229821 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-1e29177c-f9c6-449d-ae9a-02f81c673043 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1226 microversion: 2.1 time: 0.121193 Jun 06 21:06:05.231821 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 66/134] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:05 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1226 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:05.291156 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1ddf587a-781f-4151-9813-35dbaac7fd1f tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:05.292456 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1ddf587a-781f-4151-9813-35dbaac7fd1f tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:05.316920 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ddf587a-781f-4151-9813-35dbaac7fd1f tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:05.317740 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ddf587a-781f-4151-9813-35dbaac7fd1f tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:05.323496 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ddf587a-781f-4151-9813-35dbaac7fd1f tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:05.326219 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ddf587a-781f-4151-9813-35dbaac7fd1f tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:06.260649 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-82c0356c-00c4-450b-bea5-2fe078243613 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:06.260649 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-82c0356c-00c4-450b-bea5-2fe078243613 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:06.301039 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-82c0356c-00c4-450b-bea5-2fe078243613 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:06.305169 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-82c0356c-00c4-450b-bea5-2fe078243613 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:06.308849 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-82c0356c-00c4-450b-bea5-2fe078243613 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:06.317840 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-82c0356c-00c4-450b-bea5-2fe078243613 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:06.412393 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1ddf587a-781f-4151-9813-35dbaac7fd1f tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:06.424703 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1ddf587a-781f-4151-9813-35dbaac7fd1f tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1314 microversion: 2.1 time: 1.141207 Jun 06 21:06:06.428271 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 69/135] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:05 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1314 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:06.585510 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-82c0356c-00c4-450b-bea5-2fe078243613 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:06.612678 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-82c0356c-00c4-450b-bea5-2fe078243613 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1226 microversion: 2.1 time: 0.365190 Jun 06 21:06:06.624403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 67/136] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:06 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1226 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:06:07.462666 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9d18d019-4370-43dc-90f2-fbec2276ca39 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:07.464147 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9d18d019-4370-43dc-90f2-fbec2276ca39 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:07.485410 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9d18d019-4370-43dc-90f2-fbec2276ca39 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:07.486378 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9d18d019-4370-43dc-90f2-fbec2276ca39 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:07.488534 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9d18d019-4370-43dc-90f2-fbec2276ca39 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:07.489868 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9d18d019-4370-43dc-90f2-fbec2276ca39 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:07.645076 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-96c9593c-4323-4e26-9ff5-b00fad347639 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:07.648936 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-96c9593c-4323-4e26-9ff5-b00fad347639 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:07.678972 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-96c9593c-4323-4e26-9ff5-b00fad347639 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:07.689349 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-96c9593c-4323-4e26-9ff5-b00fad347639 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:07.690862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-96c9593c-4323-4e26-9ff5-b00fad347639 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:07.692477 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-96c9593c-4323-4e26-9ff5-b00fad347639 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:07.813129 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9d18d019-4370-43dc-90f2-fbec2276ca39 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:07.822789 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9d18d019-4370-43dc-90f2-fbec2276ca39 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1314 microversion: 2.1 time: 0.369418 Jun 06 21:06:07.825707 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 70/137] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:07 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:07.879220 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-96c9593c-4323-4e26-9ff5-b00fad347639 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:07.896700 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-96c9593c-4323-4e26-9ff5-b00fad347639 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1226 microversion: 2.1 time: 0.269168 Jun 06 21:06:07.897978 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 68/138] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:07 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1226 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:08.858307 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8d2935f7-0f1e-4059-8bf5-edec5c650db3 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:08.859404 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8d2935f7-0f1e-4059-8bf5-edec5c650db3 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:08.885170 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:08.892931 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d2935f7-0f1e-4059-8bf5-edec5c650db3 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:08.895885 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d2935f7-0f1e-4059-8bf5-edec5c650db3 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:08.898711 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d2935f7-0f1e-4059-8bf5-edec5c650db3 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:08.900653 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d2935f7-0f1e-4059-8bf5-edec5c650db3 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:08.933834 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-52117876-6910-489a-ac46-646963836527 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:08.937421 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-52117876-6910-489a-ac46-646963836527 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:08.989665 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-52117876-6910-489a-ac46-646963836527 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:08.994592 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-52117876-6910-489a-ac46-646963836527 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:08.996391 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-52117876-6910-489a-ac46-646963836527 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:08.999523 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-52117876-6910-489a-ac46-646963836527 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:09.176860 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-52117876-6910-489a-ac46-646963836527 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:09.203433 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-52117876-6910-489a-ac46-646963836527 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1274 microversion: 2.1 time: 0.282607 Jun 06 21:06:09.210518 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 69/139] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:08 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1274 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:09.415555 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8d2935f7-0f1e-4059-8bf5-edec5c650db3 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:09.426027 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8d2935f7-0f1e-4059-8bf5-edec5c650db3 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1314 microversion: 2.1 time: 0.576982 Jun 06 21:06:09.427043 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 71/140] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:08 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1314 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:10.231871 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-dbd8e2c7-4124-42cc-b8d3-c6302abd1c90 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:10.235442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-dbd8e2c7-4124-42cc-b8d3-c6302abd1c90 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:10.253250 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-dbd8e2c7-4124-42cc-b8d3-c6302abd1c90 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:10.254249 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-dbd8e2c7-4124-42cc-b8d3-c6302abd1c90 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:10.256512 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-dbd8e2c7-4124-42cc-b8d3-c6302abd1c90 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:10.257657 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-dbd8e2c7-4124-42cc-b8d3-c6302abd1c90 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:10.335021 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-b8a3ce94-2d13-4537-891c-4d316c0f9697 req-aaaa472e-b8ef-46cf-b59b-4fb5a91d32fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9258ebef-e9e5-47b9-84b9-d02803d028b1", "tag": "8ea2812d-8bbf-448e-878b-0b84bae40aa1"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:06:10.389280 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-b8a3ce94-2d13-4537-891c-4d316c0f9697 req-aaaa472e-b8ef-46cf-b59b-4fb5a91d32fc service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:10.390087 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-b8a3ce94-2d13-4537-891c-4d316c0f9697 req-aaaa472e-b8ef-46cf-b59b-4fb5a91d32fc service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:10.426980 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-dbd8e2c7-4124-42cc-b8d3-c6302abd1c90 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:10.438037 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-b8a3ce94-2d13-4537-891c-4d316c0f9697 req-aaaa472e-b8ef-46cf-b59b-4fb5a91d32fc service nova] Creating event network-changed:8ea2812d-8bbf-448e-878b-0b84bae40aa1 for instance 9258ebef-e9e5-47b9-84b9-d02803d028b1 on hv-cinder-84488 Jun 06 21:06:10.450547 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-b8a3ce94-2d13-4537-891c-4d316c0f9697 req-aaaa472e-b8ef-46cf-b59b-4fb5a91d32fc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122971 Jun 06 21:06:10.454540 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 72/141] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:06:10.467115 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b4478a0f-030d-4dd2-af07-ece6b39a4bb5 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:10.474389 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b4478a0f-030d-4dd2-af07-ece6b39a4bb5 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:10.489954 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-dbd8e2c7-4124-42cc-b8d3-c6302abd1c90 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1280 microversion: 2.1 time: 0.266197 Jun 06 21:06:10.492765 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4478a0f-030d-4dd2-af07-ece6b39a4bb5 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:10.495662 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 70/142] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:10 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1280 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:10.497474 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4478a0f-030d-4dd2-af07-ece6b39a4bb5 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:10.499291 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4478a0f-030d-4dd2-af07-ece6b39a4bb5 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:10.501772 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4478a0f-030d-4dd2-af07-ece6b39a4bb5 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:10.748683 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-71e60d07-ef57-49de-a407-4c8640b73b33 req-7c154e47-dbe5-434b-be87-3c80d3823dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f03e0091-74a5-4481-8832-6c3c63a05513", "name": "network-vif-plugged", "status": "completed", "tag": "7365f89f-bf7b-41fa-b1b6-79e6861ba5fc"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:06:10.770198 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-71e60d07-ef57-49de-a407-4c8640b73b33 req-7c154e47-dbe5-434b-be87-3c80d3823dbd service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:10.770925 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-71e60d07-ef57-49de-a407-4c8640b73b33 req-7c154e47-dbe5-434b-be87-3c80d3823dbd service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:10.797013 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-71e60d07-ef57-49de-a407-4c8640b73b33 req-7c154e47-dbe5-434b-be87-3c80d3823dbd service nova] Creating event network-vif-plugged:7365f89f-bf7b-41fa-b1b6-79e6861ba5fc for instance f03e0091-74a5-4481-8832-6c3c63a05513 on hv-cinder-84488 Jun 06 21:06:10.804571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-71e60d07-ef57-49de-a407-4c8640b73b33 req-7c154e47-dbe5-434b-be87-3c80d3823dbd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060377 Jun 06 21:06:10.805448 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 71/143] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:06:10.836605 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b4478a0f-030d-4dd2-af07-ece6b39a4bb5 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:10.851303 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b4478a0f-030d-4dd2-af07-ece6b39a4bb5 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1314 microversion: 2.1 time: 0.394228 Jun 06 21:06:10.852736 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 73/144] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:10 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:11.516258 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2b6a24d3-e6cc-4786-a3c7-1b008be6ec8a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:11.518255 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-2b6a24d3-e6cc-4786-a3c7-1b008be6ec8a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:11.535560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2b6a24d3-e6cc-4786-a3c7-1b008be6ec8a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:11.536207 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2b6a24d3-e6cc-4786-a3c7-1b008be6ec8a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:11.537045 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2b6a24d3-e6cc-4786-a3c7-1b008be6ec8a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:11.537614 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2b6a24d3-e6cc-4786-a3c7-1b008be6ec8a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:11.761438 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2b6a24d3-e6cc-4786-a3c7-1b008be6ec8a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:11.771646 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-2b6a24d3-e6cc-4786-a3c7-1b008be6ec8a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1322 microversion: 2.1 time: 0.261914 Jun 06 21:06:11.772554 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 72/145] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:11 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:11.877831 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-11e33ec7-a74b-45c0-8123-cbdb2fdbed09 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:11.878927 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-11e33ec7-a74b-45c0-8123-cbdb2fdbed09 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:11.885756 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-11e33ec7-a74b-45c0-8123-cbdb2fdbed09 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:11.886455 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-11e33ec7-a74b-45c0-8123-cbdb2fdbed09 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:11.887669 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-11e33ec7-a74b-45c0-8123-cbdb2fdbed09 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:11.888731 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-11e33ec7-a74b-45c0-8123-cbdb2fdbed09 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:12.068200 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-11e33ec7-a74b-45c0-8123-cbdb2fdbed09 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:12.080427 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-11e33ec7-a74b-45c0-8123-cbdb2fdbed09 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1314 microversion: 2.1 time: 0.206867 Jun 06 21:06:12.081543 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 74/146] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:11 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:12.797115 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b486832a-29a5-4901-a18c-200ec4d4ff4b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:12.797708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-b486832a-29a5-4901-a18c-200ec4d4ff4b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:12.805283 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b486832a-29a5-4901-a18c-200ec4d4ff4b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:12.805727 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b486832a-29a5-4901-a18c-200ec4d4ff4b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:12.806497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b486832a-29a5-4901-a18c-200ec4d4ff4b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:12.806922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b486832a-29a5-4901-a18c-200ec4d4ff4b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:12.952048 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-b486832a-29a5-4901-a18c-200ec4d4ff4b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:12.960813 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-b486832a-29a5-4901-a18c-200ec4d4ff4b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1322 microversion: 2.1 time: 0.167674 Jun 06 21:06:12.961397 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 73/147] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:12 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:13.101033 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3bb74cf6-15f9-4096-800c-6cfe1e219d48 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:13.101692 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3bb74cf6-15f9-4096-800c-6cfe1e219d48 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:13.108626 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3bb74cf6-15f9-4096-800c-6cfe1e219d48 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:13.109066 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3bb74cf6-15f9-4096-800c-6cfe1e219d48 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:13.109830 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3bb74cf6-15f9-4096-800c-6cfe1e219d48 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:13.110249 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3bb74cf6-15f9-4096-800c-6cfe1e219d48 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:13.338075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3bb74cf6-15f9-4096-800c-6cfe1e219d48 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:13.348464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3bb74cf6-15f9-4096-800c-6cfe1e219d48 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1314 microversion: 2.1 time: 0.251304 Jun 06 21:06:13.349707 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 75/148] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:13 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:13.980182 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-67bba273-fcd6-4365-9296-066bfac5b690 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:13.981334 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-67bba273-fcd6-4365-9296-066bfac5b690 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:13.984181 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=4 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:13.994272 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-67bba273-fcd6-4365-9296-066bfac5b690 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:13.995053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-67bba273-fcd6-4365-9296-066bfac5b690 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:13.996549 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-67bba273-fcd6-4365-9296-066bfac5b690 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:13.997350 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-67bba273-fcd6-4365-9296-066bfac5b690 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:14.086691 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=18 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:14.253685 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-67bba273-fcd6-4365-9296-066bfac5b690 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:14.268967 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-67bba273-fcd6-4365-9296-066bfac5b690 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1322 microversion: 2.1 time: 0.292618 Jun 06 21:06:14.269998 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 74/149] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:13 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:06:14.380711 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c6a2dc2e-cef1-492b-ad6e-0dcad478d277 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:14.382245 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c6a2dc2e-cef1-492b-ad6e-0dcad478d277 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:14.395041 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c6a2dc2e-cef1-492b-ad6e-0dcad478d277 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:14.396439 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c6a2dc2e-cef1-492b-ad6e-0dcad478d277 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:14.398179 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c6a2dc2e-cef1-492b-ad6e-0dcad478d277 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:14.399158 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c6a2dc2e-cef1-492b-ad6e-0dcad478d277 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:14.703932 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c6a2dc2e-cef1-492b-ad6e-0dcad478d277 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:14.737747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-30bba65b-bd2c-4535-a449-6341d1def37c req-ac9c4d1c-2144-4181-87fe-85369d976c38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fecd9b3-66d5-4e24-bad4-2d483ea3c7af", "tag": "b95d8a9d-3d6a-440d-8dd9-e5bc4da3d13d"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:06:14.753851 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c6a2dc2e-cef1-492b-ad6e-0dcad478d277 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1314 microversion: 2.1 time: 0.382542 Jun 06 21:06:14.774988 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 76/150] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:14 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:14.779189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-30bba65b-bd2c-4535-a449-6341d1def37c req-ac9c4d1c-2144-4181-87fe-85369d976c38 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:14.779811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-30bba65b-bd2c-4535-a449-6341d1def37c req-ac9c4d1c-2144-4181-87fe-85369d976c38 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:14.798033 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-30bba65b-bd2c-4535-a449-6341d1def37c req-ac9c4d1c-2144-4181-87fe-85369d976c38 service nova] Creating event network-changed:b95d8a9d-3d6a-440d-8dd9-e5bc4da3d13d for instance 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af on hv-cinder-84488 Jun 06 21:06:14.805496 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-30bba65b-bd2c-4535-a449-6341d1def37c req-ac9c4d1c-2144-4181-87fe-85369d976c38 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093055 Jun 06 21:06:14.806369 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 75/151] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:06:15.294928 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-76eafb63-efd7-4582-807f-933728b6e5be tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:15.295539 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-76eafb63-efd7-4582-807f-933728b6e5be tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:15.302182 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76eafb63-efd7-4582-807f-933728b6e5be tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:15.302711 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76eafb63-efd7-4582-807f-933728b6e5be tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:15.303607 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76eafb63-efd7-4582-807f-933728b6e5be tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:15.304115 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76eafb63-efd7-4582-807f-933728b6e5be tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:15.481639 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-76eafb63-efd7-4582-807f-933728b6e5be tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:15.495803 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-76eafb63-efd7-4582-807f-933728b6e5be tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1322 microversion: 2.1 time: 0.200451 Jun 06 21:06:15.497250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 77/152] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:15 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1322 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:15.775981 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-473f8267-21c6-4f5f-a21d-bb9262cd5bd5 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:15.777113 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-473f8267-21c6-4f5f-a21d-bb9262cd5bd5 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:15.785290 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-473f8267-21c6-4f5f-a21d-bb9262cd5bd5 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:15.785947 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-473f8267-21c6-4f5f-a21d-bb9262cd5bd5 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:15.786824 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-473f8267-21c6-4f5f-a21d-bb9262cd5bd5 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:15.787335 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-473f8267-21c6-4f5f-a21d-bb9262cd5bd5 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:15.790937 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=92 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:15.962444 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-473f8267-21c6-4f5f-a21d-bb9262cd5bd5 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:15.971498 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-473f8267-21c6-4f5f-a21d-bb9262cd5bd5 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1314 microversion: 2.1 time: 0.201328 Jun 06 21:06:15.972213 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 76/153] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:15 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:16.521889 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-cd067b7a-88a1-4332-aa3a-6318cfb83eb2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:16.524064 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-cd067b7a-88a1-4332-aa3a-6318cfb83eb2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:16.539929 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cd067b7a-88a1-4332-aa3a-6318cfb83eb2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:16.541265 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cd067b7a-88a1-4332-aa3a-6318cfb83eb2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:16.542548 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cd067b7a-88a1-4332-aa3a-6318cfb83eb2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:16.543242 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cd067b7a-88a1-4332-aa3a-6318cfb83eb2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:16.732342 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-cd067b7a-88a1-4332-aa3a-6318cfb83eb2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:16.741771 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-cd067b7a-88a1-4332-aa3a-6318cfb83eb2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1322 microversion: 2.1 time: 0.229071 Jun 06 21:06:16.742541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 78/154] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:16 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:16.996780 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-3125e477-329b-4045-b3b6-0bc3fe7cea2c tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:16.997528 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-3125e477-329b-4045-b3b6-0bc3fe7cea2c tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:17.005504 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3125e477-329b-4045-b3b6-0bc3fe7cea2c tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:17.006164 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3125e477-329b-4045-b3b6-0bc3fe7cea2c tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:17.007001 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3125e477-329b-4045-b3b6-0bc3fe7cea2c tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:17.007465 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3125e477-329b-4045-b3b6-0bc3fe7cea2c tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:17.320830 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-3125e477-329b-4045-b3b6-0bc3fe7cea2c tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:17.335785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-3125e477-329b-4045-b3b6-0bc3fe7cea2c tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1314 microversion: 2.1 time: 0.343261 Jun 06 21:06:17.336961 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 77/155] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:16 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:17.760721 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2785a64f-fa1f-43f1-8c3f-7be63b1bebe3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:17.761431 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2785a64f-fa1f-43f1-8c3f-7be63b1bebe3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:17.768998 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2785a64f-fa1f-43f1-8c3f-7be63b1bebe3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:17.769440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2785a64f-fa1f-43f1-8c3f-7be63b1bebe3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:17.770204 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2785a64f-fa1f-43f1-8c3f-7be63b1bebe3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:17.770630 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2785a64f-fa1f-43f1-8c3f-7be63b1bebe3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:17.981778 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2785a64f-fa1f-43f1-8c3f-7be63b1bebe3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:17.992474 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2785a64f-fa1f-43f1-8c3f-7be63b1bebe3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1322 microversion: 2.1 time: 0.235463 Jun 06 21:06:17.993722 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 79/156] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:17 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:18.363480 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b64f4a95-e45a-4009-8dc4-07bb679aebd8 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:18.364263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-b64f4a95-e45a-4009-8dc4-07bb679aebd8 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:18.375795 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b64f4a95-e45a-4009-8dc4-07bb679aebd8 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:18.376485 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b64f4a95-e45a-4009-8dc4-07bb679aebd8 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:18.377330 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b64f4a95-e45a-4009-8dc4-07bb679aebd8 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:18.377735 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b64f4a95-e45a-4009-8dc4-07bb679aebd8 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:18.542307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-b64f4a95-e45a-4009-8dc4-07bb679aebd8 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:18.551474 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-b64f4a95-e45a-4009-8dc4-07bb679aebd8 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1314 microversion: 2.1 time: 0.192469 Jun 06 21:06:18.552302 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 78/157] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:18 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:06:19.022706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-72113579-7b2c-4da0-8ab2-f58c8b5a8272 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:19.023959 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-72113579-7b2c-4da0-8ab2-f58c8b5a8272 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:19.050864 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72113579-7b2c-4da0-8ab2-f58c8b5a8272 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:19.051787 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72113579-7b2c-4da0-8ab2-f58c8b5a8272 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:19.053451 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72113579-7b2c-4da0-8ab2-f58c8b5a8272 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:19.054230 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72113579-7b2c-4da0-8ab2-f58c8b5a8272 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:19.266841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-72113579-7b2c-4da0-8ab2-f58c8b5a8272 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:19.281847 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-72113579-7b2c-4da0-8ab2-f58c8b5a8272 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1322 microversion: 2.1 time: 0.267502 Jun 06 21:06:19.283270 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 80/158] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:19 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:19.569008 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-8d165b5e-d0ab-4d03-a8db-3c777225800d tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:19.569710 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-8d165b5e-d0ab-4d03-a8db-3c777225800d tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:19.583539 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8d165b5e-d0ab-4d03-a8db-3c777225800d tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:19.583539 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8d165b5e-d0ab-4d03-a8db-3c777225800d tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:19.583539 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8d165b5e-d0ab-4d03-a8db-3c777225800d tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:19.583539 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8d165b5e-d0ab-4d03-a8db-3c777225800d tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:19.756301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-8d165b5e-d0ab-4d03-a8db-3c777225800d tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:19.764689 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-8d165b5e-d0ab-4d03-a8db-3c777225800d tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1314 microversion: 2.1 time: 0.200222 Jun 06 21:06:19.765320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 79/159] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:19 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:20.316210 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b4faf3d9-9c46-4dba-a3e6-e2a20bab867c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:20.319106 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b4faf3d9-9c46-4dba-a3e6-e2a20bab867c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:20.336107 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4faf3d9-9c46-4dba-a3e6-e2a20bab867c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:20.336558 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4faf3d9-9c46-4dba-a3e6-e2a20bab867c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:20.337360 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4faf3d9-9c46-4dba-a3e6-e2a20bab867c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:20.337820 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4faf3d9-9c46-4dba-a3e6-e2a20bab867c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:20.538188 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b4faf3d9-9c46-4dba-a3e6-e2a20bab867c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:20.550738 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b4faf3d9-9c46-4dba-a3e6-e2a20bab867c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1322 microversion: 2.1 time: 0.245386 Jun 06 21:06:20.552054 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 81/160] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:20 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:20.799256 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-c48c6ec5-a6d8-488e-8389-5579f6f1e1ca tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:20.800016 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-c48c6ec5-a6d8-488e-8389-5579f6f1e1ca tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:20.807414 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c48c6ec5-a6d8-488e-8389-5579f6f1e1ca tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:20.807863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c48c6ec5-a6d8-488e-8389-5579f6f1e1ca tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:20.809096 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c48c6ec5-a6d8-488e-8389-5579f6f1e1ca tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:20.809096 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c48c6ec5-a6d8-488e-8389-5579f6f1e1ca tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:20.983769 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c48c6ec5-a6d8-488e-8389-5579f6f1e1ca tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:20.992757 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-c48c6ec5-a6d8-488e-8389-5579f6f1e1ca tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1314 microversion: 2.1 time: 0.197308 Jun 06 21:06:20.993361 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 80/161] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:20 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:21.576932 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-61f4ca4b-2bb6-45b4-9e4f-5fe7b18249bc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:21.579440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-61f4ca4b-2bb6-45b4-9e4f-5fe7b18249bc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:21.587522 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61f4ca4b-2bb6-45b4-9e4f-5fe7b18249bc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:21.588021 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61f4ca4b-2bb6-45b4-9e4f-5fe7b18249bc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:21.588819 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61f4ca4b-2bb6-45b4-9e4f-5fe7b18249bc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:21.589246 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61f4ca4b-2bb6-45b4-9e4f-5fe7b18249bc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:21.917090 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-61f4ca4b-2bb6-45b4-9e4f-5fe7b18249bc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:21.928558 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-61f4ca4b-2bb6-45b4-9e4f-5fe7b18249bc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1322 microversion: 2.1 time: 0.358893 Jun 06 21:06:21.929496 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 82/162] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:21 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1322 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:06:22.028686 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-f11419f6-d95a-4a0f-93c7-13b8a124788b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:22.029959 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-f11419f6-d95a-4a0f-93c7-13b8a124788b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:22.075023 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f11419f6-d95a-4a0f-93c7-13b8a124788b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:22.075895 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f11419f6-d95a-4a0f-93c7-13b8a124788b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:22.077435 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f11419f6-d95a-4a0f-93c7-13b8a124788b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:22.078220 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f11419f6-d95a-4a0f-93c7-13b8a124788b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:22.763442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-f11419f6-d95a-4a0f-93c7-13b8a124788b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:22.778357 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-f11419f6-d95a-4a0f-93c7-13b8a124788b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1314 microversion: 2.1 time: 0.765815 Jun 06 21:06:22.782147 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 81/163] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:22 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1314 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:22.953570 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3ce40989-bb88-4521-857c-79960a96f116 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:22.957683 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3ce40989-bb88-4521-857c-79960a96f116 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:22.986742 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3ce40989-bb88-4521-857c-79960a96f116 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:22.988786 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3ce40989-bb88-4521-857c-79960a96f116 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:22.993774 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3ce40989-bb88-4521-857c-79960a96f116 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:22.995081 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3ce40989-bb88-4521-857c-79960a96f116 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:23.006075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:23.321818 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3ce40989-bb88-4521-857c-79960a96f116 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:23.345327 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3ce40989-bb88-4521-857c-79960a96f116 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1322 microversion: 2.1 time: 0.397694 Jun 06 21:06:23.346051 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 83/164] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:22 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1322 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:23.808817 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e2cf24e0-2a70-4f4d-85a7-e3a550f66bfa tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:23.809816 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-e2cf24e0-2a70-4f4d-85a7-e3a550f66bfa tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:23.821501 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e2cf24e0-2a70-4f4d-85a7-e3a550f66bfa tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:23.822329 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e2cf24e0-2a70-4f4d-85a7-e3a550f66bfa tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:23.823777 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e2cf24e0-2a70-4f4d-85a7-e3a550f66bfa tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:23.824629 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e2cf24e0-2a70-4f4d-85a7-e3a550f66bfa tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:24.373492 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a465e64a-c1e6-4f9e-8ab9-5f86861ec428 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:24.373492 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a465e64a-c1e6-4f9e-8ab9-5f86861ec428 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:24.419966 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a465e64a-c1e6-4f9e-8ab9-5f86861ec428 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:24.420380 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a465e64a-c1e6-4f9e-8ab9-5f86861ec428 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:24.421222 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a465e64a-c1e6-4f9e-8ab9-5f86861ec428 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:24.439541 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e2cf24e0-2a70-4f4d-85a7-e3a550f66bfa tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:24.445621 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a465e64a-c1e6-4f9e-8ab9-5f86861ec428 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:24.469116 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-e2cf24e0-2a70-4f4d-85a7-e3a550f66bfa tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1497 microversion: 2.1 time: 0.665691 Jun 06 21:06:24.470898 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 82/165] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:23 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1497 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:24.727617 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-5223640c-7a09-44a0-b571-a3af4c999b00 req-d9e13326-9c60-41b6-901d-02349c1703ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9258ebef-e9e5-47b9-84b9-d02803d028b1", "name": "network-vif-plugged", "status": "completed", "tag": "8ea2812d-8bbf-448e-878b-0b84bae40aa1"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:06:24.754863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-5223640c-7a09-44a0-b571-a3af4c999b00 req-d9e13326-9c60-41b6-901d-02349c1703ac service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:24.768740 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-5223640c-7a09-44a0-b571-a3af4c999b00 req-d9e13326-9c60-41b6-901d-02349c1703ac service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:24.798552 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-5223640c-7a09-44a0-b571-a3af4c999b00 req-d9e13326-9c60-41b6-901d-02349c1703ac service nova] Creating event network-vif-plugged:8ea2812d-8bbf-448e-878b-0b84bae40aa1 for instance 9258ebef-e9e5-47b9-84b9-d02803d028b1 on hv-cinder-84488 Jun 06 21:06:24.816700 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-5223640c-7a09-44a0-b571-a3af4c999b00 req-d9e13326-9c60-41b6-901d-02349c1703ac service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094044 Jun 06 21:06:24.825424 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 83/166] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:06:25.317905 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-f5d37f07-37fe-48ef-b067-e74810069cf4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:25.325388 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-f5d37f07-37fe-48ef-b067-e74810069cf4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:25.340524 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f5d37f07-37fe-48ef-b067-e74810069cf4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:25.343211 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f5d37f07-37fe-48ef-b067-e74810069cf4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:25.345304 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f5d37f07-37fe-48ef-b067-e74810069cf4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:25.349516 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f5d37f07-37fe-48ef-b067-e74810069cf4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:25.388850 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a465e64a-c1e6-4f9e-8ab9-5f86861ec428 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:25.412988 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a465e64a-c1e6-4f9e-8ab9-5f86861ec428 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1322 microversion: 2.1 time: 1.045446 Jun 06 21:06:25.413667 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 84/167] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:24 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1322 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:06:25.455219 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-f5d37f07-37fe-48ef-b067-e74810069cf4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Going to try to terminate instance {{(pid=117860) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 21:06:25.735847 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-f5d37f07-37fe-48ef-b067-e74810069cf4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "DELETE /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 204 len: 0 microversion: 2.1 time: 0.424563 Jun 06 21:06:25.739576 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 84/168] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:06:25 2022] DELETE /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 21:06:25.754182 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a68cb9ed-7f88-4ed9-ba3b-08c8d9fe580f tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:25.755249 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a68cb9ed-7f88-4ed9-ba3b-08c8d9fe580f tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:25.799191 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a68cb9ed-7f88-4ed9-ba3b-08c8d9fe580f tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:25.799656 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a68cb9ed-7f88-4ed9-ba3b-08c8d9fe580f tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:25.800480 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a68cb9ed-7f88-4ed9-ba3b-08c8d9fe580f tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:25.800912 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a68cb9ed-7f88-4ed9-ba3b-08c8d9fe580f tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:26.292141 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a68cb9ed-7f88-4ed9-ba3b-08c8d9fe580f tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:26.304418 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a68cb9ed-7f88-4ed9-ba3b-08c8d9fe580f tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1503 microversion: 2.1 time: 0.558702 Jun 06 21:06:26.305304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 85/169] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:25 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1503 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:26.460807 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-440b5278-4020-403a-bdc5-f7a0c713325f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:26.462591 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-440b5278-4020-403a-bdc5-f7a0c713325f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:26.492463 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-440b5278-4020-403a-bdc5-f7a0c713325f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:26.494767 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-440b5278-4020-403a-bdc5-f7a0c713325f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:26.498135 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-440b5278-4020-403a-bdc5-f7a0c713325f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:26.498757 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-440b5278-4020-403a-bdc5-f7a0c713325f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:26.912299 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-440b5278-4020-403a-bdc5-f7a0c713325f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:26.923041 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-440b5278-4020-403a-bdc5-f7a0c713325f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1322 microversion: 2.1 time: 0.482525 Jun 06 21:06:26.923908 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 85/170] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:26 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1322 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:27.331863 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4ba9691a-1aee-49a4-ad80-a7b8b692fedf tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:27.333221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4ba9691a-1aee-49a4-ad80-a7b8b692fedf tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:27.365607 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4ba9691a-1aee-49a4-ad80-a7b8b692fedf tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:27.367103 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4ba9691a-1aee-49a4-ad80-a7b8b692fedf tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:27.368964 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4ba9691a-1aee-49a4-ad80-a7b8b692fedf tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:27.371609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4ba9691a-1aee-49a4-ad80-a7b8b692fedf tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:27.820808 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4ba9691a-1aee-49a4-ad80-a7b8b692fedf tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:27.836700 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4ba9691a-1aee-49a4-ad80-a7b8b692fedf tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1503 microversion: 2.1 time: 0.516445 Jun 06 21:06:27.838071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 86/171] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:27 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1503 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:27.951601 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-a5c003f9-6832-4fbe-bf38-417d933f9e44 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:27.953067 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-a5c003f9-6832-4fbe-bf38-417d933f9e44 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:27.966974 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a5c003f9-6832-4fbe-bf38-417d933f9e44 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:27.970170 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a5c003f9-6832-4fbe-bf38-417d933f9e44 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:27.971373 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a5c003f9-6832-4fbe-bf38-417d933f9e44 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:27.972083 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a5c003f9-6832-4fbe-bf38-417d933f9e44 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:28.598494 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-ae051017-339a-46c8-a80e-0771226bcee3 req-2070cc24-9ec7-42a0-b1df-bf0e8ff191c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fecd9b3-66d5-4e24-bad4-2d483ea3c7af", "name": "network-vif-plugged", "status": "completed", "tag": "b95d8a9d-3d6a-440d-8dd9-e5bc4da3d13d"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:06:28.606103 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-a5c003f9-6832-4fbe-bf38-417d933f9e44 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:28.616886 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-ae051017-339a-46c8-a80e-0771226bcee3 req-2070cc24-9ec7-42a0-b1df-bf0e8ff191c6 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:28.618673 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-ae051017-339a-46c8-a80e-0771226bcee3 req-2070cc24-9ec7-42a0-b1df-bf0e8ff191c6 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:28.622781 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-a5c003f9-6832-4fbe-bf38-417d933f9e44 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1322 microversion: 2.1 time: 0.675066 Jun 06 21:06:28.623732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 86/172] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:27 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1322 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:06:28.634790 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-ae051017-339a-46c8-a80e-0771226bcee3 req-2070cc24-9ec7-42a0-b1df-bf0e8ff191c6 service nova] Creating event network-vif-plugged:b95d8a9d-3d6a-440d-8dd9-e5bc4da3d13d for instance 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af on hv-cinder-84488 Jun 06 21:06:28.640926 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-ae051017-339a-46c8-a80e-0771226bcee3 req-2070cc24-9ec7-42a0-b1df-bf0e8ff191c6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046530 Jun 06 21:06:28.642401 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 87/173] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:06:28.869083 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-bc770550-4aed-4ebd-b1a8-46691fb337fe tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:28.871875 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-bc770550-4aed-4ebd-b1a8-46691fb337fe tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:28.909641 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bc770550-4aed-4ebd-b1a8-46691fb337fe tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:28.922515 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bc770550-4aed-4ebd-b1a8-46691fb337fe tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:28.926227 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bc770550-4aed-4ebd-b1a8-46691fb337fe tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:28.929733 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bc770550-4aed-4ebd-b1a8-46691fb337fe tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:29.649563 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-84a8cf40-3c8c-4074-9292-144b59a4943b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:29.662730 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-84a8cf40-3c8c-4074-9292-144b59a4943b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:29.692612 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-84a8cf40-3c8c-4074-9292-144b59a4943b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:29.693396 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-84a8cf40-3c8c-4074-9292-144b59a4943b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:29.694780 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-84a8cf40-3c8c-4074-9292-144b59a4943b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:29.695549 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-84a8cf40-3c8c-4074-9292-144b59a4943b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:30.244881 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-bc770550-4aed-4ebd-b1a8-46691fb337fe tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:30.297660 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-bc770550-4aed-4ebd-b1a8-46691fb337fe tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1503 microversion: 2.1 time: 1.434119 Jun 06 21:06:30.304591 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 87/174] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:28 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1503 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:30.493416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-84a8cf40-3c8c-4074-9292-144b59a4943b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:30.507389 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-84a8cf40-3c8c-4074-9292-144b59a4943b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1322 microversion: 2.1 time: 0.867870 Jun 06 21:06:30.517555 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 88/175] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:29 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1322 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:30.685061 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-3860c475-a7a7-44c2-a513-e78ef7548fa5 req-8cbaa72d-370a-46c8-ae9c-964fe9fefd93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f03e0091-74a5-4481-8832-6c3c63a05513", "name": "network-vif-unplugged", "status": "completed", "tag": "7365f89f-bf7b-41fa-b1b6-79e6861ba5fc"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:06:30.717481 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-3860c475-a7a7-44c2-a513-e78ef7548fa5 req-8cbaa72d-370a-46c8-ae9c-964fe9fefd93 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:30.718484 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-3860c475-a7a7-44c2-a513-e78ef7548fa5 req-8cbaa72d-370a-46c8-ae9c-964fe9fefd93 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:30.751757 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-3860c475-a7a7-44c2-a513-e78ef7548fa5 req-8cbaa72d-370a-46c8-ae9c-964fe9fefd93 service nova] Creating event network-vif-unplugged:7365f89f-bf7b-41fa-b1b6-79e6861ba5fc for instance f03e0091-74a5-4481-8832-6c3c63a05513 on hv-cinder-84488 Jun 06 21:06:30.755924 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-0e32309f-c547-4643-9db0-7f8c3c01385e req-447af4f9-6a5f-420b-b0f3-bd227d3619e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f03e0091-74a5-4481-8832-6c3c63a05513", "name": "network-vif-deleted", "tag": "7365f89f-bf7b-41fa-b1b6-79e6861ba5fc"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:06:30.764202 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-3860c475-a7a7-44c2-a513-e78ef7548fa5 req-8cbaa72d-370a-46c8-ae9c-964fe9fefd93 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099681 Jun 06 21:06:30.776129 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 88/176] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:06:30.785929 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-0e32309f-c547-4643-9db0-7f8c3c01385e req-447af4f9-6a5f-420b-b0f3-bd227d3619e9 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:30.786366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-0e32309f-c547-4643-9db0-7f8c3c01385e req-447af4f9-6a5f-420b-b0f3-bd227d3619e9 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:30.814944 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-0e32309f-c547-4643-9db0-7f8c3c01385e req-447af4f9-6a5f-420b-b0f3-bd227d3619e9 service nova] Creating event network-vif-deleted:7365f89f-bf7b-41fa-b1b6-79e6861ba5fc for instance f03e0091-74a5-4481-8832-6c3c63a05513 on hv-cinder-84488 Jun 06 21:06:30.820617 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-0e32309f-c547-4643-9db0-7f8c3c01385e req-447af4f9-6a5f-420b-b0f3-bd227d3619e9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068318 Jun 06 21:06:30.821547 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 89/177] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:06:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:06:31.350211 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-4ddba348-4cd4-476f-821a-5b1680782ead tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:31.351660 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-4ddba348-4cd4-476f-821a-5b1680782ead tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:31.409501 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4ddba348-4cd4-476f-821a-5b1680782ead tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:31.414666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4ddba348-4cd4-476f-821a-5b1680782ead tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:31.419076 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4ddba348-4cd4-476f-821a-5b1680782ead tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:31.422163 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4ddba348-4cd4-476f-821a-5b1680782ead tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:31.529549 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9736213b-e7f8-4327-8a04-21036df24c08 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:31.531946 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9736213b-e7f8-4327-8a04-21036df24c08 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:31.548154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9736213b-e7f8-4327-8a04-21036df24c08 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:31.548841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9736213b-e7f8-4327-8a04-21036df24c08 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:31.552895 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9736213b-e7f8-4327-8a04-21036df24c08 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:31.557232 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9736213b-e7f8-4327-8a04-21036df24c08 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:31.576653 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4ddba348-4cd4-476f-821a-5b1680782ead tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:31.580083 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4ddba348-4cd4-476f-821a-5b1680782ead tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:31.583499 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.objects.instance [None req-4ddba348-4cd4-476f-821a-5b1680782ead tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lazy-loading 'fault' on Instance uuid f03e0091-74a5-4481-8832-6c3c63a05513 {{(pid=117860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:06:31.756780 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-4ddba348-4cd4-476f-821a-5b1680782ead tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:31.797497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-4ddba348-4cd4-476f-821a-5b1680782ead tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 200 len: 1304 microversion: 2.1 time: 0.467765 Jun 06 21:06:31.813426 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 89/178] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:31 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 1304 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:06:31.867073 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9736213b-e7f8-4327-8a04-21036df24c08 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:31.878486 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9736213b-e7f8-4327-8a04-21036df24c08 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1322 microversion: 2.1 time: 0.356563 Jun 06 21:06:31.879721 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 90/179] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:31 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:32.825375 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-abca05aa-5ab6-4e9f-bcf2-16ca30613ebe tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:32.826093 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-abca05aa-5ab6-4e9f-bcf2-16ca30613ebe tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: f03e0091-74a5-4481-8832-6c3c63a05513] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:32.843150 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-abca05aa-5ab6-4e9f-bcf2-16ca30613ebe tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:32.845714 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-abca05aa-5ab6-4e9f-bcf2-16ca30613ebe tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:32.847886 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-abca05aa-5ab6-4e9f-bcf2-16ca30613ebe tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:32.848779 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-abca05aa-5ab6-4e9f-bcf2-16ca30613ebe tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:32.898948 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-caa4e60f-5d2f-4968-82a3-8c5965c30424 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:32.899773 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-caa4e60f-5d2f-4968-82a3-8c5965c30424 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:32.916679 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-caa4e60f-5d2f-4968-82a3-8c5965c30424 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:32.918286 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-abca05aa-5ab6-4e9f-bcf2-16ca30613ebe tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] HTTP exception thrown: Instance f03e0091-74a5-4481-8832-6c3c63a05513 could not be found. Jun 06 21:06:32.920070 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-abca05aa-5ab6-4e9f-bcf2-16ca30613ebe tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Request method failure captured: Jun 06 21:06:32.920070 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 HTTP/1.1 Jun 06 21:06:32.920070 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:06:32.920070 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:06:32.920070 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:06:32.920070 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 0 Jun 06 21:06:32.920070 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:06:32.920070 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:06:32.920070 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:06:32.920070 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:06:32.920070 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinmwtlEaWMbRDSFHAddorOSdria0r_muDwuADXQ_N-EC12ZABlsk6xGRgaKzlYXUUIE8Lm81ik0rMNxfhQxzgG0HXv6ADDC92-fazU2yK86jeZhuzwEkQoB3BOfAtTeg31WYma9acsCPhb0zdyg5kU422GgWAsCn2iB1fjS-ig-jOAdQ Jun 06 21:06:32.920070 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:06:32.920070 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:06:32.920070 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:06:32.920070 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:06:32.920070 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:06:32.920070 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:06:32.920070 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: f1a72d23da2148c598c119821ec8a513 Jun 06 21:06:32.920070 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-VolumesActionsTest-481127680 Jun 06 21:06:32.920070 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:06:32.920070 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:06:32.922663 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f1a72d23da2148c598c119821ec8a513"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f1a72d23da2148c598c119821ec8a513"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f1a72d23da2148c598c119821ec8a513"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f1a72d23da2148c598c119821ec8a513"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:06:32.922663 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-VolumesActionsTest-481127680 Jun 06 21:06:32.922663 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: f1a72d23da2148c598c119821ec8a513 Jun 06 21:06:32.922663 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-VolumesActionsTest-481127680 Jun 06 21:06:32.922663 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-VolumesActionsTest-481127680-project Jun 06 21:06:32.922663 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:06:32.922663 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:06:32.922663 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: 101810e54c274bf48c3cab586d24e764 Jun 06 21:06:32.922663 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-VolumesActionsTest-481127680-project Jun 06 21:06:32.922663 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: > Jun 06 21:06:32.922663 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Instance f03e0091-74a5-4481-8832-6c3c63a05513 could not be found. Jun 06 21:06:32.922663 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'id': 'f03e0091-74a5-4481-8832-6c3c63a05513'} Jun 06 21:06:32.924332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:06:32.924332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:06:32.924332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:06:32.924332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:06:32.924332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:06:32.924332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:06:32.924332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:06:32.924332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:06:32.924332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:06:32.924332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:06:32.924332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f03e0091-74a5-4481-8832-6c3c63a05513 could not be found. Jun 06 21:06:32.924332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:06:32.924332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:06:32.924332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:06:32.924332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:06:32.924332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:06:32.924332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:06:32.924332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:06:32.924332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:06:32.924332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:06:32.926927 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:06:32.926927 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:06:32.926927 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:06:32.926927 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:06:32.926927 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:06:32.926927 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:06:32.926927 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:06:32.926927 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f03e0091-74a5-4481-8832-6c3c63a05513 could not be found. Jun 06 21:06:32.926927 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:06:32.926927 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:06:32.926927 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:06:32.926927 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:06:32.926927 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:06:32.926927 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:06:32.926927 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:06:32.926927 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:06:32.926927 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f03e0091-74a5-4481-8832-6c3c63a05513 could not be found. Jun 06 21:06:32.926927 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:06:32.929331 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-caa4e60f-5d2f-4968-82a3-8c5965c30424 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:32.929331 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-caa4e60f-5d2f-4968-82a3-8c5965c30424 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:32.929331 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-caa4e60f-5d2f-4968-82a3-8c5965c30424 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:32.934119 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-abca05aa-5ab6-4e9f-bcf2-16ca30613ebe tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Returning 404 to user: Instance f03e0091-74a5-4481-8832-6c3c63a05513 could not be found. {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:06:32.934902 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-abca05aa-5ab6-4e9f-bcf2-16ca30613ebe tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513" status: 404 len: 111 microversion: 2.1 time: 0.113712 Jun 06 21:06:32.935490 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 90/180] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:32 2022] GET /compute/v2.1/servers/f03e0091-74a5-4481-8832-6c3c63a05513 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:06:33.212797 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-d3891fa1-9bf9-4f09-9e69-e4ec0ddb8348 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-337989201", "imageRef": "e4266a01-7d22-4036-91e8-3ec50e3369c1", "flavorRef": "452", "networks": [{"uuid": "d022549a-4a85-4392-8e6a-5d4d29f676e1"}]}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:06:33.327684 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.network.neutron [None req-d3891fa1-9bf9-4f09-9e69-e4ec0ddb8348 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] validate_networks() for [('d022549a-4a85-4392-8e6a-5d4d29f676e1', None, None, None, None, None)] {{(pid=117860) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 21:06:33.931848 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-caa4e60f-5d2f-4968-82a3-8c5965c30424 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:33.966397 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-caa4e60f-5d2f-4968-82a3-8c5965c30424 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1514 microversion: 2.1 time: 1.072785 Jun 06 21:06:33.967430 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 91/181] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:32 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1514 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:06:34.007219 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7f58b4fa-ef01-4d43-94c0-bda7a74f88da tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:06:34.021738 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7f58b4fa-ef01-4d43-94c0-bda7a74f88da tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:34.059845 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7f58b4fa-ef01-4d43-94c0-bda7a74f88da tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:34.060809 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7f58b4fa-ef01-4d43-94c0-bda7a74f88da tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:34.062219 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7f58b4fa-ef01-4d43-94c0-bda7a74f88da tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:34.062995 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7f58b4fa-ef01-4d43-94c0-bda7a74f88da tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:34.216851 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-7f58b4fa-ef01-4d43-94c0-bda7a74f88da tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lazy-loading 'flavor' on Instance uuid 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:06:34.461076 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-d3891fa1-9bf9-4f09-9e69-e4ec0ddb8348 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Flavor limits 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 21:06:34.461605 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-d3891fa1-9bf9-4f09-9e69-e4ec0ddb8348 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Image limits 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 21:06:34.462315 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-d3891fa1-9bf9-4f09-9e69-e4ec0ddb8348 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Flavor pref 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 21:06:34.462984 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-d3891fa1-9bf9-4f09-9e69-e4ec0ddb8348 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Image pref 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 21:06:34.464103 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-d3891fa1-9bf9-4f09-9e69-e4ec0ddb8348 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 21:06:34.467518 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:34.489887 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d3891fa1-9bf9-4f09-9e69-e4ec0ddb8348 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:34.492300 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d3891fa1-9bf9-4f09-9e69-e4ec0ddb8348 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:34.496537 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d3891fa1-9bf9-4f09-9e69-e4ec0ddb8348 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:34.498523 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d3891fa1-9bf9-4f09-9e69-e4ec0ddb8348 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:34.561788 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-d3891fa1-9bf9-4f09-9e69-e4ec0ddb8348 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Getting quotas for project f1a72d23da2148c598c119821ec8a513. Resources: {'ram', 'cores', 'instances'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:06:34.577728 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7f58b4fa-ef01-4d43-94c0-bda7a74f88da tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "POST /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af/action" status: 200 len: 32 microversion: 2.1 time: 0.590856 Jun 06 21:06:34.578020 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-d3891fa1-9bf9-4f09-9e69-e4ec0ddb8348 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Getting quotas for user 101810e54c274bf48c3cab586d24e764 and project f1a72d23da2148c598c119821ec8a513. Resources: {'ram', 'cores', 'instances'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:06:34.578863 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 92/182] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 6 21:06:33 2022] POST /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af/action => generated 32 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 21:06:34.592410 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5df80e58-869a-4727-b91c-82e311506da5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:34.595634 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5df80e58-869a-4727-b91c-82e311506da5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:34.608378 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5df80e58-869a-4727-b91c-82e311506da5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:34.609279 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5df80e58-869a-4727-b91c-82e311506da5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:34.609769 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-d3891fa1-9bf9-4f09-9e69-e4ec0ddb8348 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Going to run 1 instances... {{(pid=117860) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 21:06:34.610694 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5df80e58-869a-4727-b91c-82e311506da5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:34.611317 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5df80e58-869a-4727-b91c-82e311506da5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:34.614743 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-d3891fa1-9bf9-4f09-9e69-e4ec0ddb8348 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: 45249ccf-6fd2-43ab-9738-fc525f8229fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4266a01-7d22-4036-91e8-3ec50e3369c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 21:06:34.738198 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-d3891fa1-9bf9-4f09-9e69-e4ec0ddb8348 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.535544 Jun 06 21:06:34.739909 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 91/183] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 6 21:06:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 06 21:06:34.749956 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-efcc917e-f72f-4b3a-8512-ac251b94dfd9 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:34.750606 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-efcc917e-f72f-4b3a-8512-ac251b94dfd9 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: 45249ccf-6fd2-43ab-9738-fc525f8229fb] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:34.927445 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5df80e58-869a-4727-b91c-82e311506da5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:34.938238 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5df80e58-869a-4727-b91c-82e311506da5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.351672 Jun 06 21:06:34.941653 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 93/184] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:34 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:06:35.009183 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-efcc917e-f72f-4b3a-8512-ac251b94dfd9 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:35.042654 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-efcc917e-f72f-4b3a-8512-ac251b94dfd9 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb" status: 200 len: 1213 microversion: 2.1 time: 0.293891 Jun 06 21:06:35.046393 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 92/185] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:34 2022] GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb => generated 1213 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:35.966194 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d609b5d9-81ed-45c4-8a4a-dbdd621c691b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:35.968353 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d609b5d9-81ed-45c4-8a4a-dbdd621c691b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:36.004040 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d609b5d9-81ed-45c4-8a4a-dbdd621c691b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:36.016050 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d609b5d9-81ed-45c4-8a4a-dbdd621c691b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:36.019879 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d609b5d9-81ed-45c4-8a4a-dbdd621c691b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:36.021042 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d609b5d9-81ed-45c4-8a4a-dbdd621c691b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:36.063500 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-ef30e832-3b46-464a-a86a-bcae2a235130 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:36.065290 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-ef30e832-3b46-464a-a86a-bcae2a235130 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: 45249ccf-6fd2-43ab-9738-fc525f8229fb] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:36.082118 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ef30e832-3b46-464a-a86a-bcae2a235130 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:36.083234 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ef30e832-3b46-464a-a86a-bcae2a235130 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:36.087084 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ef30e832-3b46-464a-a86a-bcae2a235130 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:36.090619 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ef30e832-3b46-464a-a86a-bcae2a235130 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:36.263446 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-ef30e832-3b46-464a-a86a-bcae2a235130 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:36.279288 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-ef30e832-3b46-464a-a86a-bcae2a235130 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb" status: 200 len: 1209 microversion: 2.1 time: 0.220242 Jun 06 21:06:36.281658 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 93/186] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:36 2022] GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb => generated 1209 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:36.636462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d609b5d9-81ed-45c4-8a4a-dbdd621c691b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:36.660563 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d609b5d9-81ed-45c4-8a4a-dbdd621c691b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.701367 Jun 06 21:06:36.660563 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 94/187] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:35 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:36.717688 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e29d10bd-416c-4a62-afed-049dc4ee5edb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:36.723815 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-e29d10bd-416c-4a62-afed-049dc4ee5edb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:36.737939 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e29d10bd-416c-4a62-afed-049dc4ee5edb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:36.738406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e29d10bd-416c-4a62-afed-049dc4ee5edb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:36.739224 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e29d10bd-416c-4a62-afed-049dc4ee5edb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:36.739788 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e29d10bd-416c-4a62-afed-049dc4ee5edb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:36.839483 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:36.888307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-e29d10bd-416c-4a62-afed-049dc4ee5edb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583/ips" status: 200 len: 151 microversion: 2.1 time: 0.188992 Jun 06 21:06:36.899930 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 94/188] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jun 6 21:06:36 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583/ips => generated 151 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:06:37.305117 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4398862a-e87c-4537-a7c1-70db9a0814f6 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:37.310433 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4398862a-e87c-4537-a7c1-70db9a0814f6 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: 45249ccf-6fd2-43ab-9738-fc525f8229fb] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:37.360353 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4398862a-e87c-4537-a7c1-70db9a0814f6 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:37.361468 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4398862a-e87c-4537-a7c1-70db9a0814f6 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:37.362488 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4398862a-e87c-4537-a7c1-70db9a0814f6 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:37.365176 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4398862a-e87c-4537-a7c1-70db9a0814f6 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:37.660957 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4398862a-e87c-4537-a7c1-70db9a0814f6 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:37.675868 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4398862a-e87c-4537-a7c1-70db9a0814f6 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb" status: 200 len: 1271 microversion: 2.1 time: 0.380121 Jun 06 21:06:37.678874 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 95/189] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:37 2022] GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb => generated 1271 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:37.686328 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-9137b6c0-bb7a-43dc-8351-0736c5ec1647 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:37.687169 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-9137b6c0-bb7a-43dc-8351-0736c5ec1647 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:37.712344 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9137b6c0-bb7a-43dc-8351-0736c5ec1647 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:37.712964 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9137b6c0-bb7a-43dc-8351-0736c5ec1647 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:37.726400 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9137b6c0-bb7a-43dc-8351-0736c5ec1647 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:37.727287 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9137b6c0-bb7a-43dc-8351-0736c5ec1647 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:38.700487 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-91559887-cf04-40bd-8df9-65e53d9a1dba tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:38.701608 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-91559887-cf04-40bd-8df9-65e53d9a1dba tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: 45249ccf-6fd2-43ab-9738-fc525f8229fb] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:38.750307 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-91559887-cf04-40bd-8df9-65e53d9a1dba tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:38.766398 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-91559887-cf04-40bd-8df9-65e53d9a1dba tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:38.768201 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-91559887-cf04-40bd-8df9-65e53d9a1dba tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:38.776053 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-91559887-cf04-40bd-8df9-65e53d9a1dba tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:39.222162 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-91559887-cf04-40bd-8df9-65e53d9a1dba tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:39.257628 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-91559887-cf04-40bd-8df9-65e53d9a1dba tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb" status: 200 len: 1271 microversion: 2.1 time: 0.562755 Jun 06 21:06:39.269754 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 96/190] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:38 2022] GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb => generated 1271 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:39.275873 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2fcbb635-5ac6-47da-ba8a-7f831059a4cd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0aae6ddd-8aed-4286-9ebd-c429736820bf"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:06:39.278174 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2fcbb635-5ac6-47da-ba8a-7f831059a4cd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:39.285697 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=52 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:39.288445 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2fcbb635-5ac6-47da-ba8a-7f831059a4cd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:39.290141 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2fcbb635-5ac6-47da-ba8a-7f831059a4cd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:39.291859 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2fcbb635-5ac6-47da-ba8a-7f831059a4cd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:39.292599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2fcbb635-5ac6-47da-ba8a-7f831059a4cd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:39.325393 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-9137b6c0-bb7a-43dc-8351-0736c5ec1647 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:39.369922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-9137b6c0-bb7a-43dc-8351-0736c5ec1647 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 1.681401 Jun 06 21:06:39.371175 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 95/191] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:37 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:40.160855 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:40.189139 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2fcbb635-5ac6-47da-ba8a-7f831059a4cd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "POST /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.917815 Jun 06 21:06:40.192063 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 97/192] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 6 21:06:39 2022] POST /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583/os-volume_attachments => generated 194 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:06:40.276348 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-7368bf5d-3684-4509-9776-6a985ca3ba45 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:40.278248 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-7368bf5d-3684-4509-9776-6a985ca3ba45 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: 45249ccf-6fd2-43ab-9738-fc525f8229fb] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:40.294619 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7368bf5d-3684-4509-9776-6a985ca3ba45 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:40.295669 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7368bf5d-3684-4509-9776-6a985ca3ba45 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:40.298100 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7368bf5d-3684-4509-9776-6a985ca3ba45 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:40.298757 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7368bf5d-3684-4509-9776-6a985ca3ba45 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:40.406422 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-57038b2b-50c0-403f-b62e-1af683cd7639 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:40.407413 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-57038b2b-50c0-403f-b62e-1af683cd7639 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:40.430309 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-57038b2b-50c0-403f-b62e-1af683cd7639 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:40.430758 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-57038b2b-50c0-403f-b62e-1af683cd7639 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:40.438187 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-57038b2b-50c0-403f-b62e-1af683cd7639 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:40.441140 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-57038b2b-50c0-403f-b62e-1af683cd7639 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:40.641855 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-7368bf5d-3684-4509-9776-6a985ca3ba45 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:40.655245 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-7368bf5d-3684-4509-9776-6a985ca3ba45 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb" status: 200 len: 1313 microversion: 2.1 time: 0.384189 Jun 06 21:06:40.656785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 96/193] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:40 2022] GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:40.989398 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-9f992057-a770-40be-9873-de4462d7a356 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:40.990240 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-9f992057-a770-40be-9873-de4462d7a356 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:41.006794 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9f992057-a770-40be-9873-de4462d7a356 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:41.009602 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9f992057-a770-40be-9873-de4462d7a356 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:41.013309 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9f992057-a770-40be-9873-de4462d7a356 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:41.014938 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9f992057-a770-40be-9873-de4462d7a356 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:41.093072 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-9f992057-a770-40be-9873-de4462d7a356 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0/ips" status: 200 len: 151 microversion: 2.20 time: 0.111511 Jun 06 21:06:41.102309 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 97/194] 10.222.0.33 () {60 vars in 1288 bytes} [Mon Jun 6 21:06:40 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0/ips => generated 151 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 21:06:41.170106 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-57038b2b-50c0-403f-b62e-1af683cd7639 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:41.198798 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-57038b2b-50c0-403f-b62e-1af683cd7639 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.802293 Jun 06 21:06:41.204620 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 98/195] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:40 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:41.674866 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-443adcff-ad87-4394-8347-95db113de792 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:41.676290 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-443adcff-ad87-4394-8347-95db113de792 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: 45249ccf-6fd2-43ab-9738-fc525f8229fb] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:41.695584 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-443adcff-ad87-4394-8347-95db113de792 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:41.702528 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-443adcff-ad87-4394-8347-95db113de792 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:41.703380 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-443adcff-ad87-4394-8347-95db113de792 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:41.703820 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-443adcff-ad87-4394-8347-95db113de792 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:42.230974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7f6554cf-0ad2-4b66-ae98-2ba8543afffd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:42.232472 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7f6554cf-0ad2-4b66-ae98-2ba8543afffd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:42.255848 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7f6554cf-0ad2-4b66-ae98-2ba8543afffd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:42.257874 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7f6554cf-0ad2-4b66-ae98-2ba8543afffd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:42.264904 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7f6554cf-0ad2-4b66-ae98-2ba8543afffd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:42.265576 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7f6554cf-0ad2-4b66-ae98-2ba8543afffd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:42.276831 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-443adcff-ad87-4394-8347-95db113de792 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:42.319571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-443adcff-ad87-4394-8347-95db113de792 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb" status: 200 len: 1313 microversion: 2.1 time: 0.648015 Jun 06 21:06:42.321974 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 98/196] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:41 2022] GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb => generated 1313 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:43.202624 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7f6554cf-0ad2-4b66-ae98-2ba8543afffd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:43.218123 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7f6554cf-0ad2-4b66-ae98-2ba8543afffd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.992835 Jun 06 21:06:43.228693 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 99/197] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:42 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:43.327332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-bad40b2d-5245-4016-a26b-998c3b6b3624 req-f1ceaeb0-1d58-4950-a01e-0b6dd89290f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45249ccf-6fd2-43ab-9738-fc525f8229fb", "tag": "8fa007ad-184f-4837-a6ae-4a779efa387a"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:06:43.343686 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-acca8f72-c72d-40e3-b4a3-77f1b26c3496 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:43.345183 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-acca8f72-c72d-40e3-b4a3-77f1b26c3496 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: 45249ccf-6fd2-43ab-9738-fc525f8229fb] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:43.355203 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-acca8f72-c72d-40e3-b4a3-77f1b26c3496 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:43.355700 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-acca8f72-c72d-40e3-b4a3-77f1b26c3496 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:43.356572 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-acca8f72-c72d-40e3-b4a3-77f1b26c3496 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:43.357009 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-acca8f72-c72d-40e3-b4a3-77f1b26c3496 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:43.368716 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-bad40b2d-5245-4016-a26b-998c3b6b3624 req-f1ceaeb0-1d58-4950-a01e-0b6dd89290f2 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:43.369811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-bad40b2d-5245-4016-a26b-998c3b6b3624 req-f1ceaeb0-1d58-4950-a01e-0b6dd89290f2 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:43.461344 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-bad40b2d-5245-4016-a26b-998c3b6b3624 req-f1ceaeb0-1d58-4950-a01e-0b6dd89290f2 service nova] Creating event network-changed:8fa007ad-184f-4837-a6ae-4a779efa387a for instance 45249ccf-6fd2-43ab-9738-fc525f8229fb on hv-cinder-84488 Jun 06 21:06:43.482030 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-bad40b2d-5245-4016-a26b-998c3b6b3624 req-f1ceaeb0-1d58-4950-a01e-0b6dd89290f2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161265 Jun 06 21:06:43.484505 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 99/198] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:06:43.776467 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-acca8f72-c72d-40e3-b4a3-77f1b26c3496 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:43.787846 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-acca8f72-c72d-40e3-b4a3-77f1b26c3496 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb" status: 200 len: 1313 microversion: 2.1 time: 0.447857 Jun 06 21:06:43.799618 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 100/199] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:43 2022] GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:06:44.203198 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-eed7d764-0acd-4bfe-8258-09816a9c6ddd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:06:44.204193 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-eed7d764-0acd-4bfe-8258-09816a9c6ddd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:44.214298 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eed7d764-0acd-4bfe-8258-09816a9c6ddd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:44.214904 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eed7d764-0acd-4bfe-8258-09816a9c6ddd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:44.215716 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eed7d764-0acd-4bfe-8258-09816a9c6ddd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:44.216207 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eed7d764-0acd-4bfe-8258-09816a9c6ddd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:44.258445 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-eed7d764-0acd-4bfe-8258-09816a9c6ddd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lazy-loading 'flavor' on Instance uuid 1886e3bf-c735-4f91-8a2f-0bc6996982e0 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:06:44.529780 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=2 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:44.557745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-7913ed39-2173-4b59-af04-3567d7e3b794 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Action: 'create', calling method: .version_select at 0x7f27262e25e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1736120711", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIPMQ8jles9PxJ7zy5IfSQ5bV/IqJHUIeXroEYmXawge8bcx2TO9BhE0Sa5BAFYXvAgohqJS5BUOLlDy/pSnAZRLQRhHS3ZSGmzJcX8D0Sg1uxsxK8sG/hEzQFl+ZUedpA=="}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:06:44.598379 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-7913ed39-2173-4b59-af04-3567d7e3b794 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Getting quotas for project 370f0df7dc4745edb578a5f922c0f57f. Resources: {'key_pairs'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:06:44.611783 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-7913ed39-2173-4b59-af04-3567d7e3b794 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Getting quotas for user 67481128d30049d29d5f0e66b1a4c970 and project 370f0df7dc4745edb578a5f922c0f57f. Resources: {'key_pairs'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:06:44.678540 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-7913ed39-2173-4b59-af04-3567d7e3b794 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.533383 Jun 06 21:06:44.680171 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 100/200] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jun 6 21:06:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:06:44.703184 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-69956b9c-0289-461f-b613-e79ccf478685 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:44.706685 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-69956b9c-0289-461f-b613-e79ccf478685 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:44.715160 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-eed7d764-0acd-4bfe-8258-09816a9c6ddd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "POST /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0/action" status: 202 len: 0 microversion: 2.20 time: 0.515633 Jun 06 21:06:44.720262 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 101/201] 10.222.0.33 () {62 vars in 1318 bytes} [Mon Jun 6 21:06:44 2022] POST /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 06 21:06:44.726900 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f0e3206e-a17c-42a7-afb1-0eeb9d653471 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:44.727880 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f0e3206e-a17c-42a7-afb1-0eeb9d653471 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:44.728640 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-69956b9c-0289-461f-b613-e79ccf478685 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:44.730466 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-69956b9c-0289-461f-b613-e79ccf478685 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:44.732966 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-69956b9c-0289-461f-b613-e79ccf478685 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:44.734272 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-69956b9c-0289-461f-b613-e79ccf478685 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:44.736725 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f0e3206e-a17c-42a7-afb1-0eeb9d653471 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:44.737601 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f0e3206e-a17c-42a7-afb1-0eeb9d653471 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:44.738968 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f0e3206e-a17c-42a7-afb1-0eeb9d653471 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:44.739698 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f0e3206e-a17c-42a7-afb1-0eeb9d653471 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:45.086416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f0e3206e-a17c-42a7-afb1-0eeb9d653471 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:45.098150 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f0e3206e-a17c-42a7-afb1-0eeb9d653471 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:45.101934 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f0e3206e-a17c-42a7-afb1-0eeb9d653471 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:45.103695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f0e3206e-a17c-42a7-afb1-0eeb9d653471 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1724 microversion: 2.20 time: 0.381798 Jun 06 21:06:45.104948 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 102/202] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:06:44 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1724 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:06:45.121410 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-834ae870-8865-4a55-a837-f2078d50daa3 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:45.122261 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-834ae870-8865-4a55-a837-f2078d50daa3 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: 45249ccf-6fd2-43ab-9738-fc525f8229fb] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:45.136052 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-834ae870-8865-4a55-a837-f2078d50daa3 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:45.139327 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-834ae870-8865-4a55-a837-f2078d50daa3 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:45.140776 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-834ae870-8865-4a55-a837-f2078d50daa3 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:45.142653 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-834ae870-8865-4a55-a837-f2078d50daa3 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:45.276178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-69956b9c-0289-461f-b613-e79ccf478685 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:45.300186 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-69956b9c-0289-461f-b613-e79ccf478685 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.618139 Jun 06 21:06:45.301151 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 101/203] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:44 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:45.565289 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-834ae870-8865-4a55-a837-f2078d50daa3 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:45.574172 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-834ae870-8865-4a55-a837-f2078d50daa3 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb" status: 200 len: 1313 microversion: 2.1 time: 0.467838 Jun 06 21:06:45.577818 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 103/204] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:45 2022] GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb => generated 1313 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:46.156344 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-c80cff50-8d4b-4b9b-81f4-6fb326e72586 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:46.161083 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-c80cff50-8d4b-4b9b-81f4-6fb326e72586 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:46.197792 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c80cff50-8d4b-4b9b-81f4-6fb326e72586 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:46.198653 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c80cff50-8d4b-4b9b-81f4-6fb326e72586 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:46.207796 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c80cff50-8d4b-4b9b-81f4-6fb326e72586 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:46.211736 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c80cff50-8d4b-4b9b-81f4-6fb326e72586 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:46.349235 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-86701d27-c2f0-49bb-b811-ff863d236e17 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:46.355859 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-86701d27-c2f0-49bb-b811-ff863d236e17 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:46.369362 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86701d27-c2f0-49bb-b811-ff863d236e17 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:46.370893 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86701d27-c2f0-49bb-b811-ff863d236e17 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:46.374019 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86701d27-c2f0-49bb-b811-ff863d236e17 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:46.377150 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86701d27-c2f0-49bb-b811-ff863d236e17 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:46.452135 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c80cff50-8d4b-4b9b-81f4-6fb326e72586 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:46.469621 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c80cff50-8d4b-4b9b-81f4-6fb326e72586 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:46.473875 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c80cff50-8d4b-4b9b-81f4-6fb326e72586 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:46.476929 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-c80cff50-8d4b-4b9b-81f4-6fb326e72586 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1724 microversion: 2.20 time: 0.346897 Jun 06 21:06:46.480914 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 102/205] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:06:46 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1724 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:06:46.603436 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-dcbe853f-032c-486b-a5d2-a406183613c1 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:46.604520 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-dcbe853f-032c-486b-a5d2-a406183613c1 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: 45249ccf-6fd2-43ab-9738-fc525f8229fb] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:46.619787 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-dcbe853f-032c-486b-a5d2-a406183613c1 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:46.620348 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-dcbe853f-032c-486b-a5d2-a406183613c1 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:46.622726 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-dcbe853f-032c-486b-a5d2-a406183613c1 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:46.624570 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-dcbe853f-032c-486b-a5d2-a406183613c1 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:46.747425 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-86701d27-c2f0-49bb-b811-ff863d236e17 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:46.760705 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-86701d27-c2f0-49bb-b811-ff863d236e17 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.439012 Jun 06 21:06:46.765783 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 104/206] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:46 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:47.055312 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-dcbe853f-032c-486b-a5d2-a406183613c1 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:47.066342 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-dcbe853f-032c-486b-a5d2-a406183613c1 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb" status: 200 len: 1313 microversion: 2.1 time: 0.466979 Jun 06 21:06:47.068215 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 103/207] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:46 2022] GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb => generated 1313 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:06:47.500988 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bc9d4071-95fa-4393-a217-8ffe7f87cdb2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:47.501745 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bc9d4071-95fa-4393-a217-8ffe7f87cdb2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:47.516012 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc9d4071-95fa-4393-a217-8ffe7f87cdb2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:47.522710 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc9d4071-95fa-4393-a217-8ffe7f87cdb2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:47.524279 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc9d4071-95fa-4393-a217-8ffe7f87cdb2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:47.526134 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bc9d4071-95fa-4393-a217-8ffe7f87cdb2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:47.800662 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-06a1e384-3d80-4ee0-a1bb-134e2c704a72 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:47.803439 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-06a1e384-3d80-4ee0-a1bb-134e2c704a72 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:47.846652 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-06a1e384-3d80-4ee0-a1bb-134e2c704a72 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:47.847974 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-06a1e384-3d80-4ee0-a1bb-134e2c704a72 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:47.857353 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-06a1e384-3d80-4ee0-a1bb-134e2c704a72 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:47.858017 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-06a1e384-3d80-4ee0-a1bb-134e2c704a72 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:48.097323 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bc9d4071-95fa-4393-a217-8ffe7f87cdb2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:48.168691 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bc9d4071-95fa-4393-a217-8ffe7f87cdb2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:48.173887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bc9d4071-95fa-4393-a217-8ffe7f87cdb2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:48.175363 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bc9d4071-95fa-4393-a217-8ffe7f87cdb2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1724 microversion: 2.20 time: 0.679512 Jun 06 21:06:48.191960 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 105/208] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:06:47 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1724 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:06:48.223510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-893bd5ce-2ce2-4e2c-90a9-3ec1c5843f82 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:48.224423 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-893bd5ce-2ce2-4e2c-90a9-3ec1c5843f82 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: 45249ccf-6fd2-43ab-9738-fc525f8229fb] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:48.231646 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-893bd5ce-2ce2-4e2c-90a9-3ec1c5843f82 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:48.232131 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-893bd5ce-2ce2-4e2c-90a9-3ec1c5843f82 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:48.233241 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-893bd5ce-2ce2-4e2c-90a9-3ec1c5843f82 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:48.233691 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-893bd5ce-2ce2-4e2c-90a9-3ec1c5843f82 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:48.341335 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-06a1e384-3d80-4ee0-a1bb-134e2c704a72 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:48.372074 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-06a1e384-3d80-4ee0-a1bb-134e2c704a72 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.580436 Jun 06 21:06:48.394581 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 104/209] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:47 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:48.412617 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-5f3d3a1f-ace5-42c0-9641-51a97edd58f0 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Action: 'create', calling method: .version_select at 0x7f2726288430>, body: {"keypair": {"name": "tempest-keypair-1824757023", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBycavPtJR4/0iIzcGVsWtSfxn4vXun7FbyMnE7aFMUkmGkJbQprGz4bgBYIe2mmhs2MTx3zFXVs24D4wh2aW2+EmEWT8EVxLow2WSZFOlce2cLR8rMKPxfsLB1TsXL9WA=="}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:06:48.476054 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-5f3d3a1f-ace5-42c0-9641-51a97edd58f0 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Getting quotas for project 5a771f1ab27f40aca2d546901cdcecda. Resources: {'key_pairs'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:06:48.492382 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-5f3d3a1f-ace5-42c0-9641-51a97edd58f0 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Getting quotas for user 8713cb23a93147f8b52f88e240c81d6f and project 5a771f1ab27f40aca2d546901cdcecda. Resources: {'key_pairs'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:06:48.604593 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-5f3d3a1f-ace5-42c0-9641-51a97edd58f0 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.206216 Jun 06 21:06:48.607020 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 105/210] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jun 6 21:06:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:06:48.731643 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-893bd5ce-2ce2-4e2c-90a9-3ec1c5843f82 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:48.758037 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-893bd5ce-2ce2-4e2c-90a9-3ec1c5843f82 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb" status: 200 len: 1313 microversion: 2.1 time: 0.562187 Jun 06 21:06:48.760404 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 106/211] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:48 2022] GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb => generated 1313 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:49.227949 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-59f38714-80e3-4aa0-bf6d-cdbe19706ecf tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:49.230058 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-59f38714-80e3-4aa0-bf6d-cdbe19706ecf tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:49.242603 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-59f38714-80e3-4aa0-bf6d-cdbe19706ecf tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:49.243840 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-59f38714-80e3-4aa0-bf6d-cdbe19706ecf tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:49.245705 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-59f38714-80e3-4aa0-bf6d-cdbe19706ecf tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:49.247042 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-59f38714-80e3-4aa0-bf6d-cdbe19706ecf tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:49.407252 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2e6703ca-53fc-495a-9bf6-deb03ee49a21 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:49.408407 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2e6703ca-53fc-495a-9bf6-deb03ee49a21 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:49.429504 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e6703ca-53fc-495a-9bf6-deb03ee49a21 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:49.430598 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e6703ca-53fc-495a-9bf6-deb03ee49a21 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:49.435224 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e6703ca-53fc-495a-9bf6-deb03ee49a21 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:49.436327 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e6703ca-53fc-495a-9bf6-deb03ee49a21 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:49.707545 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-59f38714-80e3-4aa0-bf6d-cdbe19706ecf tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:49.723142 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-59f38714-80e3-4aa0-bf6d-cdbe19706ecf tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:49.726374 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-59f38714-80e3-4aa0-bf6d-cdbe19706ecf tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:49.728231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-59f38714-80e3-4aa0-bf6d-cdbe19706ecf tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1724 microversion: 2.20 time: 0.508358 Jun 06 21:06:49.756675 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 106/212] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:06:49 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1724 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:06:49.784819 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-16ff80b2-a795-473a-8be7-3e62164f69e4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:49.785473 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-16ff80b2-a795-473a-8be7-3e62164f69e4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: 45249ccf-6fd2-43ab-9738-fc525f8229fb] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:49.798747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-16ff80b2-a795-473a-8be7-3e62164f69e4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:49.799198 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-16ff80b2-a795-473a-8be7-3e62164f69e4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:49.799981 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-16ff80b2-a795-473a-8be7-3e62164f69e4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:49.800133 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2e6703ca-53fc-495a-9bf6-deb03ee49a21 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:49.800593 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-16ff80b2-a795-473a-8be7-3e62164f69e4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:49.817808 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2e6703ca-53fc-495a-9bf6-deb03ee49a21 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.415471 Jun 06 21:06:49.820053 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 107/213] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:49 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:50.266953 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-16ff80b2-a795-473a-8be7-3e62164f69e4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:50.276706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-16ff80b2-a795-473a-8be7-3e62164f69e4 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb" status: 200 len: 1313 microversion: 2.1 time: 0.503741 Jun 06 21:06:50.281801 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 107/214] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:49 2022] GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb => generated 1313 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:50.770491 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-89eabfee-617a-4cf9-bba8-0a8c63205c86 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:50.771777 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-89eabfee-617a-4cf9-bba8-0a8c63205c86 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:50.774055 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-6d564870-8735-45b0-ba2b-95b37f5aa028 req-2fcd63e7-5460-4abc-809a-57ab1975583d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45249ccf-6fd2-43ab-9738-fc525f8229fb", "name": "network-vif-plugged", "status": "completed", "tag": "8fa007ad-184f-4837-a6ae-4a779efa387a"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:06:50.826051 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-6d564870-8735-45b0-ba2b-95b37f5aa028 req-2fcd63e7-5460-4abc-809a-57ab1975583d service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:50.827832 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-89eabfee-617a-4cf9-bba8-0a8c63205c86 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:50.828626 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-89eabfee-617a-4cf9-bba8-0a8c63205c86 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:50.835138 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-6d564870-8735-45b0-ba2b-95b37f5aa028 req-2fcd63e7-5460-4abc-809a-57ab1975583d service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:50.845879 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-89eabfee-617a-4cf9-bba8-0a8c63205c86 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:50.848203 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-89eabfee-617a-4cf9-bba8-0a8c63205c86 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:50.881637 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-6d564870-8735-45b0-ba2b-95b37f5aa028 req-2fcd63e7-5460-4abc-809a-57ab1975583d service nova] Creating event network-vif-plugged:8fa007ad-184f-4837-a6ae-4a779efa387a for instance 45249ccf-6fd2-43ab-9738-fc525f8229fb on hv-cinder-84488 Jun 06 21:06:50.910014 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-6d564870-8735-45b0-ba2b-95b37f5aa028 req-2fcd63e7-5460-4abc-809a-57ab1975583d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144212 Jun 06 21:06:50.911814 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 108/215] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:06:50.948808 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-c29656c5-091d-4465-95cc-d1f41c7335dd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:50.949899 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-c29656c5-091d-4465-95cc-d1f41c7335dd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:50.972894 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c29656c5-091d-4465-95cc-d1f41c7335dd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:50.973565 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c29656c5-091d-4465-95cc-d1f41c7335dd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:50.978149 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c29656c5-091d-4465-95cc-d1f41c7335dd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:50.979575 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c29656c5-091d-4465-95cc-d1f41c7335dd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:51.265069 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-89eabfee-617a-4cf9-bba8-0a8c63205c86 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:51.286121 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-89eabfee-617a-4cf9-bba8-0a8c63205c86 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:51.289548 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-89eabfee-617a-4cf9-bba8-0a8c63205c86 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:51.291817 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-89eabfee-617a-4cf9-bba8-0a8c63205c86 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1724 microversion: 2.20 time: 0.529397 Jun 06 21:06:51.293613 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 108/216] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:06:50 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1724 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:06:51.315403 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-beac417b-e385-4618-a632-b456008ef3a6 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:51.317629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-beac417b-e385-4618-a632-b456008ef3a6 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: 45249ccf-6fd2-43ab-9738-fc525f8229fb] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:51.346859 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-beac417b-e385-4618-a632-b456008ef3a6 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:51.347313 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-beac417b-e385-4618-a632-b456008ef3a6 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:51.348399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-beac417b-e385-4618-a632-b456008ef3a6 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:51.352252 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-beac417b-e385-4618-a632-b456008ef3a6 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:51.579273 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-beac417b-e385-4618-a632-b456008ef3a6 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:51.592707 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-beac417b-e385-4618-a632-b456008ef3a6 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb" status: 200 len: 1313 microversion: 2.1 time: 0.285247 Jun 06 21:06:51.602315 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 109/217] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:51 2022] GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:51.702547 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c29656c5-091d-4465-95cc-d1f41c7335dd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:51.719277 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-c29656c5-091d-4465-95cc-d1f41c7335dd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.802264 Jun 06 21:06:51.733745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 109/218] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:50 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:52.326464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-420c0f7d-ea0b-4e0e-83b6-7b57c33fc67c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:52.328436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-420c0f7d-ea0b-4e0e-83b6-7b57c33fc67c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:52.339734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-420c0f7d-ea0b-4e0e-83b6-7b57c33fc67c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:52.340524 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-420c0f7d-ea0b-4e0e-83b6-7b57c33fc67c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:52.341592 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-420c0f7d-ea0b-4e0e-83b6-7b57c33fc67c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:52.342652 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-420c0f7d-ea0b-4e0e-83b6-7b57c33fc67c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:52.553892 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-76839c8f-a87c-4607-8f66-e14a5b402d1f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-348046801", "imageRef": "e4266a01-7d22-4036-91e8-3ec50e3369c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "caa56bb2-4a47-4aeb-99db-1e89b9e32e70"}], "security_groups": [{"name": "tempest-securitygroup--1166422661"}], "key_name": "tempest-keypair-1824757023", "user_data": "}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:06:52.601483 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-420c0f7d-ea0b-4e0e-83b6-7b57c33fc67c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:52.619103 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-420c0f7d-ea0b-4e0e-83b6-7b57c33fc67c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:52.621712 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-420c0f7d-ea0b-4e0e-83b6-7b57c33fc67c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:52.623546 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-420c0f7d-ea0b-4e0e-83b6-7b57c33fc67c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1724 microversion: 2.20 time: 0.305252 Jun 06 21:06:52.624962 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 110/219] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:06:52 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1724 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:06:52.649557 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e3c7a0ce-c9a3-4777-9b5a-6bd30ab8c43b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:52.650550 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e3c7a0ce-c9a3-4777-9b5a-6bd30ab8c43b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: 45249ccf-6fd2-43ab-9738-fc525f8229fb] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:52.662178 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e3c7a0ce-c9a3-4777-9b5a-6bd30ab8c43b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:52.663417 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e3c7a0ce-c9a3-4777-9b5a-6bd30ab8c43b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:52.664724 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e3c7a0ce-c9a3-4777-9b5a-6bd30ab8c43b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:52.665510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e3c7a0ce-c9a3-4777-9b5a-6bd30ab8c43b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:52.734058 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.network.neutron [None req-76839c8f-a87c-4607-8f66-e14a5b402d1f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] validate_networks() for [('caa56bb2-4a47-4aeb-99db-1e89b9e32e70', None, None, None, None, None)] {{(pid=117860) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 21:06:52.882815 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e3c7a0ce-c9a3-4777-9b5a-6bd30ab8c43b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:52.903419 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e3c7a0ce-c9a3-4777-9b5a-6bd30ab8c43b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb" status: 200 len: 1313 microversion: 2.1 time: 0.276863 Jun 06 21:06:52.905720 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 111/220] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:52 2022] GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:52.913590 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bb795b55-ffd4-4d22-ab98-550d6f03847a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:52.914632 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bb795b55-ffd4-4d22-ab98-550d6f03847a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:52.921912 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bb795b55-ffd4-4d22-ab98-550d6f03847a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:52.922768 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bb795b55-ffd4-4d22-ab98-550d6f03847a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:52.924070 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bb795b55-ffd4-4d22-ab98-550d6f03847a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:52.924668 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bb795b55-ffd4-4d22-ab98-550d6f03847a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:52.960187 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=96,nova_cell1:UPDATE=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:53.236745 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bb795b55-ffd4-4d22-ab98-550d6f03847a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:53.253579 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bb795b55-ffd4-4d22-ab98-550d6f03847a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.345231 Jun 06 21:06:53.255151 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 112/221] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:52 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:53.524316 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-76839c8f-a87c-4607-8f66-e14a5b402d1f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Flavor limits 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 21:06:53.524832 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-76839c8f-a87c-4607-8f66-e14a5b402d1f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Image limits 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 21:06:53.525317 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-76839c8f-a87c-4607-8f66-e14a5b402d1f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Flavor pref 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 21:06:53.525714 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-76839c8f-a87c-4607-8f66-e14a5b402d1f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Image pref 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 21:06:53.526422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-76839c8f-a87c-4607-8f66-e14a5b402d1f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 21:06:53.537740 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-76839c8f-a87c-4607-8f66-e14a5b402d1f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:53.538573 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-76839c8f-a87c-4607-8f66-e14a5b402d1f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:53.539454 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-76839c8f-a87c-4607-8f66-e14a5b402d1f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:53.540158 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-76839c8f-a87c-4607-8f66-e14a5b402d1f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:53.567965 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-76839c8f-a87c-4607-8f66-e14a5b402d1f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Getting quotas for project 5a771f1ab27f40aca2d546901cdcecda. Resources: {'ram', 'cores', 'instances'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:06:53.573337 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-76839c8f-a87c-4607-8f66-e14a5b402d1f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Getting quotas for user 8713cb23a93147f8b52f88e240c81d6f and project 5a771f1ab27f40aca2d546901cdcecda. Resources: {'ram', 'cores', 'instances'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:06:53.587628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-76839c8f-a87c-4607-8f66-e14a5b402d1f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Going to run 1 instances... {{(pid=117860) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 21:06:53.590602 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-76839c8f-a87c-4607-8f66-e14a5b402d1f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4266a01-7d22-4036-91e8-3ec50e3369c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 21:06:53.649179 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ab3cf7ed-beb5-4fed-b395-83267abced4c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:53.651966 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ab3cf7ed-beb5-4fed-b395-83267abced4c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:53.680359 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ab3cf7ed-beb5-4fed-b395-83267abced4c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:53.681891 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ab3cf7ed-beb5-4fed-b395-83267abced4c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:53.687189 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ab3cf7ed-beb5-4fed-b395-83267abced4c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:53.690060 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ab3cf7ed-beb5-4fed-b395-83267abced4c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:53.697566 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-76839c8f-a87c-4607-8f66-e14a5b402d1f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.150642 Jun 06 21:06:53.709067 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 110/222] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 6 21:06:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 1163 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 06 21:06:53.723099 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-dd16f1a2-77e7-4f86-b8f8-c6b3ed606c15 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:53.728344 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-dd16f1a2-77e7-4f86-b8f8-c6b3ed606c15 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:53.877790 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-dd16f1a2-77e7-4f86-b8f8-c6b3ed606c15 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:53.889865 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-dd16f1a2-77e7-4f86-b8f8-c6b3ed606c15 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1241 microversion: 2.1 time: 0.178749 Jun 06 21:06:53.890473 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 111/223] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:53 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1241 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:53.948381 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-203a61ba-4e62-4b7b-b06b-932706a55230 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:53.949520 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-203a61ba-4e62-4b7b-b06b-932706a55230 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: 45249ccf-6fd2-43ab-9738-fc525f8229fb] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:53.970092 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-203a61ba-4e62-4b7b-b06b-932706a55230 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:53.974966 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-203a61ba-4e62-4b7b-b06b-932706a55230 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:53.976950 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-203a61ba-4e62-4b7b-b06b-932706a55230 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:53.979659 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-203a61ba-4e62-4b7b-b06b-932706a55230 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:53.981279 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ab3cf7ed-beb5-4fed-b395-83267abced4c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:53.993353 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ab3cf7ed-beb5-4fed-b395-83267abced4c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:53.994737 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ab3cf7ed-beb5-4fed-b395-83267abced4c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:53.997274 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ab3cf7ed-beb5-4fed-b395-83267abced4c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1724 microversion: 2.20 time: 0.357326 Jun 06 21:06:54.009685 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 113/224] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:06:53 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1724 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:06:54.201777 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-203a61ba-4e62-4b7b-b06b-932706a55230 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:54.220490 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-203a61ba-4e62-4b7b-b06b-932706a55230 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb" status: 200 len: 1496 microversion: 2.1 time: 0.285397 Jun 06 21:06:54.234707 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 112/225] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:53 2022] GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb => generated 1496 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:54.286671 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-30c2d97e-3373-430d-afb4-b3748e19ec13 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:54.289079 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-30c2d97e-3373-430d-afb4-b3748e19ec13 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:54.301352 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30c2d97e-3373-430d-afb4-b3748e19ec13 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:54.302571 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30c2d97e-3373-430d-afb4-b3748e19ec13 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:54.303812 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30c2d97e-3373-430d-afb4-b3748e19ec13 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:54.305013 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30c2d97e-3373-430d-afb4-b3748e19ec13 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:54.488011 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-30c2d97e-3373-430d-afb4-b3748e19ec13 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:54.497082 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-30c2d97e-3373-430d-afb4-b3748e19ec13 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.219130 Jun 06 21:06:54.509092 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 114/226] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:54 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:54.912828 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-c62cdd1c-4f3d-49df-ac2c-cfe2f3397563 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:54.913957 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-c62cdd1c-4f3d-49df-ac2c-cfe2f3397563 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:54.928787 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c62cdd1c-4f3d-49df-ac2c-cfe2f3397563 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:54.929614 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c62cdd1c-4f3d-49df-ac2c-cfe2f3397563 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:54.931937 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c62cdd1c-4f3d-49df-ac2c-cfe2f3397563 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:54.932799 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c62cdd1c-4f3d-49df-ac2c-cfe2f3397563 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:55.021817 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f196718a-bbe7-4aac-8a0b-cf33430557d7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:55.022545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f196718a-bbe7-4aac-8a0b-cf33430557d7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:55.031937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f196718a-bbe7-4aac-8a0b-cf33430557d7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:55.032354 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f196718a-bbe7-4aac-8a0b-cf33430557d7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:55.033306 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f196718a-bbe7-4aac-8a0b-cf33430557d7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:55.033938 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f196718a-bbe7-4aac-8a0b-cf33430557d7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:55.039032 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c62cdd1c-4f3d-49df-ac2c-cfe2f3397563 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:55.059095 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-c62cdd1c-4f3d-49df-ac2c-cfe2f3397563 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1293 microversion: 2.1 time: 0.147742 Jun 06 21:06:55.060691 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 113/227] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:54 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1293 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:55.258529 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-415b3ebf-bd8a-435d-8c2c-e2ab19211288 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:55.259864 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-415b3ebf-bd8a-435d-8c2c-e2ab19211288 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: 45249ccf-6fd2-43ab-9738-fc525f8229fb] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:55.275665 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-415b3ebf-bd8a-435d-8c2c-e2ab19211288 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:55.277346 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-415b3ebf-bd8a-435d-8c2c-e2ab19211288 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:55.279133 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-415b3ebf-bd8a-435d-8c2c-e2ab19211288 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:55.280276 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-415b3ebf-bd8a-435d-8c2c-e2ab19211288 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:55.317154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f196718a-bbe7-4aac-8a0b-cf33430557d7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:55.335165 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-415b3ebf-bd8a-435d-8c2c-e2ab19211288 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: 45249ccf-6fd2-43ab-9738-fc525f8229fb] Going to try to terminate instance {{(pid=117860) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 21:06:55.337188 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f196718a-bbe7-4aac-8a0b-cf33430557d7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:55.351839 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f196718a-bbe7-4aac-8a0b-cf33430557d7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:55.362526 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f196718a-bbe7-4aac-8a0b-cf33430557d7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1724 microversion: 2.20 time: 0.341040 Jun 06 21:06:55.366683 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 115/228] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:06:55 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1724 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:06:55.437000 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:55.462958 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-415b3ebf-bd8a-435d-8c2c-e2ab19211288 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "DELETE /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb" status: 204 len: 0 microversion: 2.1 time: 0.211892 Jun 06 21:06:55.466035 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 114/229] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:06:55 2022] DELETE /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 06 21:06:55.478386 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b0c1ed08-19d2-416b-a868-70f212912ffc tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:55.479904 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b0c1ed08-19d2-416b-a868-70f212912ffc tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: 45249ccf-6fd2-43ab-9738-fc525f8229fb] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:55.501120 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b0c1ed08-19d2-416b-a868-70f212912ffc tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:55.502046 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b0c1ed08-19d2-416b-a868-70f212912ffc tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:55.503917 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b0c1ed08-19d2-416b-a868-70f212912ffc tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:55.505000 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b0c1ed08-19d2-416b-a868-70f212912ffc tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:55.518428 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-cdd1b193-411e-4701-85d0-daf8d8eaa440 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:55.519616 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-cdd1b193-411e-4701-85d0-daf8d8eaa440 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:55.528305 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-cdd1b193-411e-4701-85d0-daf8d8eaa440 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:55.529069 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-cdd1b193-411e-4701-85d0-daf8d8eaa440 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:55.530198 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-cdd1b193-411e-4701-85d0-daf8d8eaa440 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:55.530829 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-cdd1b193-411e-4701-85d0-daf8d8eaa440 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:55.536800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:06:55.715858 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-cdd1b193-411e-4701-85d0-daf8d8eaa440 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:55.727973 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-cdd1b193-411e-4701-85d0-daf8d8eaa440 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.214615 Jun 06 21:06:55.732745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 115/230] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:55 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:55.740611 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b0c1ed08-19d2-416b-a868-70f212912ffc tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:55.750486 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b0c1ed08-19d2-416b-a868-70f212912ffc tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb" status: 200 len: 1502 microversion: 2.1 time: 0.277957 Jun 06 21:06:55.752854 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 116/231] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:55 2022] GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb => generated 1502 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:56.077433 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-29da78ce-5a1f-471b-b0ee-b3ec7d4bba75 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:56.079350 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-29da78ce-5a1f-471b-b0ee-b3ec7d4bba75 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:56.087097 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-29da78ce-5a1f-471b-b0ee-b3ec7d4bba75 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:56.087642 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-29da78ce-5a1f-471b-b0ee-b3ec7d4bba75 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:56.088575 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-29da78ce-5a1f-471b-b0ee-b3ec7d4bba75 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:56.089098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-29da78ce-5a1f-471b-b0ee-b3ec7d4bba75 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:56.183665 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-29da78ce-5a1f-471b-b0ee-b3ec7d4bba75 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:56.191606 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-29da78ce-5a1f-471b-b0ee-b3ec7d4bba75 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1299 microversion: 2.1 time: 0.118266 Jun 06 21:06:56.192815 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 116/232] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:56 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1299 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:06:56.393327 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ae09812d-dad1-4360-9008-6f16e933611e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:56.393986 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ae09812d-dad1-4360-9008-6f16e933611e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:56.416573 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae09812d-dad1-4360-9008-6f16e933611e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:56.417302 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae09812d-dad1-4360-9008-6f16e933611e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:56.417954 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae09812d-dad1-4360-9008-6f16e933611e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:56.418431 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ae09812d-dad1-4360-9008-6f16e933611e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:56.631044 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ae09812d-dad1-4360-9008-6f16e933611e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:56.642144 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ae09812d-dad1-4360-9008-6f16e933611e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:56.643713 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ae09812d-dad1-4360-9008-6f16e933611e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:56.644985 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ae09812d-dad1-4360-9008-6f16e933611e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1724 microversion: 2.20 time: 0.256147 Jun 06 21:06:56.645558 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 117/233] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:06:56 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:06:56.746578 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-ccdb2a61-9477-49c6-927b-76a017d09b97 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:56.747449 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-ccdb2a61-9477-49c6-927b-76a017d09b97 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:56.754107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ccdb2a61-9477-49c6-927b-76a017d09b97 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:56.754851 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ccdb2a61-9477-49c6-927b-76a017d09b97 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:56.755618 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ccdb2a61-9477-49c6-927b-76a017d09b97 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:56.756072 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ccdb2a61-9477-49c6-927b-76a017d09b97 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:56.773573 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-963cbe8b-5bfc-49a7-9c31-a4f0458b8c55 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:56.774179 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-963cbe8b-5bfc-49a7-9c31-a4f0458b8c55 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: 45249ccf-6fd2-43ab-9738-fc525f8229fb] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:56.782264 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-963cbe8b-5bfc-49a7-9c31-a4f0458b8c55 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:56.783018 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-963cbe8b-5bfc-49a7-9c31-a4f0458b8c55 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:56.784780 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-963cbe8b-5bfc-49a7-9c31-a4f0458b8c55 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:56.785393 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-963cbe8b-5bfc-49a7-9c31-a4f0458b8c55 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:57.021054 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-963cbe8b-5bfc-49a7-9c31-a4f0458b8c55 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:57.048398 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-963cbe8b-5bfc-49a7-9c31-a4f0458b8c55 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb" status: 200 len: 1502 microversion: 2.1 time: 0.282657 Jun 06 21:06:57.049431 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 118/234] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:56 2022] GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb => generated 1502 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:57.075946 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-ccdb2a61-9477-49c6-927b-76a017d09b97 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:57.095548 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-ccdb2a61-9477-49c6-927b-76a017d09b97 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.353888 Jun 06 21:06:57.109809 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 117/235] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:56 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:06:57.221292 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0e848fa3-c04e-4395-8931-7826f5aa4523 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:57.224042 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0e848fa3-c04e-4395-8931-7826f5aa4523 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:57.237602 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0e848fa3-c04e-4395-8931-7826f5aa4523 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:57.238809 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0e848fa3-c04e-4395-8931-7826f5aa4523 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:57.240612 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0e848fa3-c04e-4395-8931-7826f5aa4523 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:57.241831 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0e848fa3-c04e-4395-8931-7826f5aa4523 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:57.335805 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0e848fa3-c04e-4395-8931-7826f5aa4523 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:57.352054 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0e848fa3-c04e-4395-8931-7826f5aa4523 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1299 microversion: 2.1 time: 0.138389 Jun 06 21:06:57.353039 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 119/236] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:57 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1299 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:57.672727 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-87730723-866a-47b9-a060-199f885e328c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:57.673671 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-87730723-866a-47b9-a060-199f885e328c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:57.681163 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-87730723-866a-47b9-a060-199f885e328c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:57.681880 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-87730723-866a-47b9-a060-199f885e328c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:57.683601 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-87730723-866a-47b9-a060-199f885e328c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:57.684230 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-87730723-866a-47b9-a060-199f885e328c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:58.054841 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-87730723-866a-47b9-a060-199f885e328c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:58.064782 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-87730723-866a-47b9-a060-199f885e328c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:58.066961 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-87730723-866a-47b9-a060-199f885e328c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:58.068477 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-87730723-866a-47b9-a060-199f885e328c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1724 microversion: 2.20 time: 0.400390 Jun 06 21:06:58.080428 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5096e377-403c-4e99-9e98-06550165665b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:58.081733 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 118/237] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:06:57 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1724 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:06:58.081853 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5096e377-403c-4e99-9e98-06550165665b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: 45249ccf-6fd2-43ab-9738-fc525f8229fb] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:58.112926 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5096e377-403c-4e99-9e98-06550165665b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:58.113395 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5096e377-403c-4e99-9e98-06550165665b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:58.114220 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5096e377-403c-4e99-9e98-06550165665b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:58.114658 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5096e377-403c-4e99-9e98-06550165665b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:58.118803 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-d6beab3e-ce9e-4387-90e4-cbeffb2e87bc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:58.119448 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-d6beab3e-ce9e-4387-90e4-cbeffb2e87bc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:58.130220 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d6beab3e-ce9e-4387-90e4-cbeffb2e87bc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:58.130886 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d6beab3e-ce9e-4387-90e4-cbeffb2e87bc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:58.131905 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d6beab3e-ce9e-4387-90e4-cbeffb2e87bc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:58.132827 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d6beab3e-ce9e-4387-90e4-cbeffb2e87bc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:58.314408 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5096e377-403c-4e99-9e98-06550165665b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:58.337118 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5096e377-403c-4e99-9e98-06550165665b tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb" status: 200 len: 1502 microversion: 2.1 time: 0.262201 Jun 06 21:06:58.338650 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 120/238] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:58 2022] GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb => generated 1502 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:58.378943 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c30dfbe8-35ae-437d-94d9-1849d4ac83de tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:58.380135 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c30dfbe8-35ae-437d-94d9-1849d4ac83de tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:58.394126 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c30dfbe8-35ae-437d-94d9-1849d4ac83de tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:58.395164 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c30dfbe8-35ae-437d-94d9-1849d4ac83de tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:58.397371 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c30dfbe8-35ae-437d-94d9-1849d4ac83de tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:58.398316 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c30dfbe8-35ae-437d-94d9-1849d4ac83de tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:58.477517 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c30dfbe8-35ae-437d-94d9-1849d4ac83de tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:58.486131 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c30dfbe8-35ae-437d-94d9-1849d4ac83de tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1299 microversion: 2.1 time: 0.115627 Jun 06 21:06:58.487450 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 121/239] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:58 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1299 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:06:58.618246 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-d6beab3e-ce9e-4387-90e4-cbeffb2e87bc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:58.629542 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-d6beab3e-ce9e-4387-90e4-cbeffb2e87bc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.518337 Jun 06 21:06:58.631416 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 119/240] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:58 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:58.868253 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-9e1b21b2-90b2-44ac-8926-8d121ec3e0c6 req-06241419-8e1a-4dfb-8e97-8dbc5e3e6d66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45249ccf-6fd2-43ab-9738-fc525f8229fb", "name": "network-vif-deleted", "tag": "8fa007ad-184f-4837-a6ae-4a779efa387a"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:06:58.881895 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-9e1b21b2-90b2-44ac-8926-8d121ec3e0c6 req-06241419-8e1a-4dfb-8e97-8dbc5e3e6d66 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:58.883043 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-9e1b21b2-90b2-44ac-8926-8d121ec3e0c6 req-06241419-8e1a-4dfb-8e97-8dbc5e3e6d66 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:58.905569 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-9e1b21b2-90b2-44ac-8926-8d121ec3e0c6 req-06241419-8e1a-4dfb-8e97-8dbc5e3e6d66 service nova] Creating event network-vif-deleted:8fa007ad-184f-4837-a6ae-4a779efa387a for instance 45249ccf-6fd2-43ab-9738-fc525f8229fb on hv-cinder-84488 Jun 06 21:06:58.939402 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-9e1b21b2-90b2-44ac-8926-8d121ec3e0c6 req-06241419-8e1a-4dfb-8e97-8dbc5e3e6d66 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075285 Jun 06 21:06:58.940670 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 122/241] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:06:59.104052 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-c12a5d56-660d-4ac9-aaa0-5ac6f1a57d92 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:59.105491 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-c12a5d56-660d-4ac9-aaa0-5ac6f1a57d92 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:59.112928 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c12a5d56-660d-4ac9-aaa0-5ac6f1a57d92 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:59.114269 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c12a5d56-660d-4ac9-aaa0-5ac6f1a57d92 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:59.121489 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c12a5d56-660d-4ac9-aaa0-5ac6f1a57d92 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:59.122213 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c12a5d56-660d-4ac9-aaa0-5ac6f1a57d92 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:59.371177 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4162e6b1-a288-4c7b-9bec-ffd82e936f5a tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:59.373608 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4162e6b1-a288-4c7b-9bec-ffd82e936f5a tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: 45249ccf-6fd2-43ab-9738-fc525f8229fb] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:59.389108 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4162e6b1-a288-4c7b-9bec-ffd82e936f5a tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:59.389930 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4162e6b1-a288-4c7b-9bec-ffd82e936f5a tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:59.391332 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4162e6b1-a288-4c7b-9bec-ffd82e936f5a tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:59.393058 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4162e6b1-a288-4c7b-9bec-ffd82e936f5a tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:59.494252 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c12a5d56-660d-4ac9-aaa0-5ac6f1a57d92 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:59.500101 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4162e6b1-a288-4c7b-9bec-ffd82e936f5a tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:59.504725 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4162e6b1-a288-4c7b-9bec-ffd82e936f5a tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:59.508410 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-4162e6b1-a288-4c7b-9bec-ffd82e936f5a tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lazy-loading 'fault' on Instance uuid 45249ccf-6fd2-43ab-9738-fc525f8229fb {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:06:59.511570 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c12a5d56-660d-4ac9-aaa0-5ac6f1a57d92 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:59.524880 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c12a5d56-660d-4ac9-aaa0-5ac6f1a57d92 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:59.528565 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-c12a5d56-660d-4ac9-aaa0-5ac6f1a57d92 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1724 microversion: 2.20 time: 0.438794 Jun 06 21:06:59.532379 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 120/242] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:06:59 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1724 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:06:59.539712 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-9f194ec2-bd3f-45d9-8214-9d3cdd644852 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:59.540357 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-9f194ec2-bd3f-45d9-8214-9d3cdd644852 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:59.559277 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9f194ec2-bd3f-45d9-8214-9d3cdd644852 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:59.567910 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9f194ec2-bd3f-45d9-8214-9d3cdd644852 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:59.572080 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9f194ec2-bd3f-45d9-8214-9d3cdd644852 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:59.572775 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9f194ec2-bd3f-45d9-8214-9d3cdd644852 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:59.598321 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4162e6b1-a288-4c7b-9bec-ffd82e936f5a tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101810e54c274bf48c3cab586d24e764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1a72d23da2148c598c119821ec8a513', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:59.609985 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4162e6b1-a288-4c7b-9bec-ffd82e936f5a tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb" status: 200 len: 1303 microversion: 2.1 time: 0.254812 Jun 06 21:06:59.612136 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 123/243] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:59 2022] GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb => generated 1303 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:59.655734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b131a892-6a31-4044-a468-0376d569a0ac tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:06:59.656650 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b131a892-6a31-4044-a468-0376d569a0ac tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:06:59.670349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b131a892-6a31-4044-a468-0376d569a0ac tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:59.673081 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b131a892-6a31-4044-a468-0376d569a0ac tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:59.674080 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b131a892-6a31-4044-a468-0376d569a0ac tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:06:59.680197 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b131a892-6a31-4044-a468-0376d569a0ac tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:06:59.927736 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-9f194ec2-bd3f-45d9-8214-9d3cdd644852 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:59.946535 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b131a892-6a31-4044-a468-0376d569a0ac tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:06:59.949475 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-9f194ec2-bd3f-45d9-8214-9d3cdd644852 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1367 microversion: 2.1 time: 0.415320 Jun 06 21:06:59.950314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 121/244] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:59 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1367 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:06:59.961243 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b131a892-6a31-4044-a468-0376d569a0ac tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.309805 Jun 06 21:06:59.961974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 124/245] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:06:59 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:07:00.563506 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0c1bc583-6fe1-42cc-80e2-32de31cb060a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:00.565676 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-0c1bc583-6fe1-42cc-80e2-32de31cb060a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:00.578325 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0c1bc583-6fe1-42cc-80e2-32de31cb060a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:00.579096 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0c1bc583-6fe1-42cc-80e2-32de31cb060a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:00.580291 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0c1bc583-6fe1-42cc-80e2-32de31cb060a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:00.580683 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0c1bc583-6fe1-42cc-80e2-32de31cb060a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:00.629882 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e2626723-210d-4a30-86a2-e8325f8ec143 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:00.630500 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e2626723-210d-4a30-86a2-e8325f8ec143 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] [instance: 45249ccf-6fd2-43ab-9738-fc525f8229fb] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:00.639039 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2626723-210d-4a30-86a2-e8325f8ec143 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:00.639807 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2626723-210d-4a30-86a2-e8325f8ec143 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:00.640660 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2626723-210d-4a30-86a2-e8325f8ec143 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:00.641112 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2626723-210d-4a30-86a2-e8325f8ec143 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:00.665972 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-e2626723-210d-4a30-86a2-e8325f8ec143 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] HTTP exception thrown: Instance 45249ccf-6fd2-43ab-9738-fc525f8229fb could not be found. Jun 06 21:07:00.668750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e2626723-210d-4a30-86a2-e8325f8ec143 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Request method failure captured: Jun 06 21:07:00.668750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb HTTP/1.1 Jun 06 21:07:00.668750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:07:00.668750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:07:00.668750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:07:00.668750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:07:00.668750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:07:00.668750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:07:00.668750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:07:00.668750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:07:00.668750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinmwtlEaWMbRDSFHAddorOSdria0r_muDwuADXQ_N-EC12ZABlsk6xGRgaKzlYXUUIE8Lm81ik0rMNxfhQxzgG0HXv6ADDC92-fazU2yK86jeZhuzwEkQoB3BOfAtTeg31WYma9acsCPhb0zdyg5kU422GgWAsCn2iB1fjS-ig-jOAdQ Jun 06 21:07:00.668750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:07:00.668750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:07:00.668750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:07:00.668750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:07:00.668750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:07:00.668750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:07:00.668750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: f1a72d23da2148c598c119821ec8a513 Jun 06 21:07:00.668750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesActionsTest-481127680 Jun 06 21:07:00.668750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:07:00.668750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:07:00.671120 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f1a72d23da2148c598c119821ec8a513"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f1a72d23da2148c598c119821ec8a513"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f1a72d23da2148c598c119821ec8a513"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f1a72d23da2148c598c119821ec8a513"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:07:00.671120 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesActionsTest-481127680 Jun 06 21:07:00.671120 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: f1a72d23da2148c598c119821ec8a513 Jun 06 21:07:00.671120 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesActionsTest-481127680 Jun 06 21:07:00.671120 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesActionsTest-481127680-project Jun 06 21:07:00.671120 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:07:00.671120 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:07:00.671120 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: 101810e54c274bf48c3cab586d24e764 Jun 06 21:07:00.671120 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesActionsTest-481127680-project Jun 06 21:07:00.671120 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: > Jun 06 21:07:00.671120 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Instance 45249ccf-6fd2-43ab-9738-fc525f8229fb could not be found. Jun 06 21:07:00.671120 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '45249ccf-6fd2-43ab-9738-fc525f8229fb'} Jun 06 21:07:00.674366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:07:00.674366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:07:00.674366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:07:00.674366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:07:00.674366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:07:00.674366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:07:00.674366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:07:00.674366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:07:00.674366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:07:00.674366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:07:00.674366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45249ccf-6fd2-43ab-9738-fc525f8229fb could not be found. Jun 06 21:07:00.674366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:07:00.674366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:07:00.674366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:07:00.674366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:07:00.674366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:07:00.674366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:07:00.674366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:07:00.674366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:07:00.674366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:07:00.675913 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:07:00.675913 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:07:00.675913 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:07:00.675913 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:07:00.675913 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:07:00.675913 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:07:00.675913 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:07:00.675913 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45249ccf-6fd2-43ab-9738-fc525f8229fb could not be found. Jun 06 21:07:00.675913 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:07:00.675913 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:07:00.675913 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:07:00.675913 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:07:00.675913 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:07:00.675913 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:07:00.675913 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:07:00.675913 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:07:00.675913 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45249ccf-6fd2-43ab-9738-fc525f8229fb could not be found. Jun 06 21:07:00.675913 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:07:00.677208 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e2626723-210d-4a30-86a2-e8325f8ec143 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] Returning 404 to user: Instance 45249ccf-6fd2-43ab-9738-fc525f8229fb could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:07:00.677208 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e2626723-210d-4a30-86a2-e8325f8ec143 tempest-VolumesActionsTest-481127680 tempest-VolumesActionsTest-481127680-project] 10.222.0.33 "GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb" status: 404 len: 111 microversion: 2.1 time: 0.044401 Jun 06 21:07:00.677208 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 125/246] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:00 2022] GET /compute/v2.1/servers/45249ccf-6fd2-43ab-9738-fc525f8229fb => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:07:00.932384 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-0c1bc583-6fe1-42cc-80e2-32de31cb060a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:00.939219 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-0c1bc583-6fe1-42cc-80e2-32de31cb060a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:00.941077 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-0c1bc583-6fe1-42cc-80e2-32de31cb060a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:00.942372 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-0c1bc583-6fe1-42cc-80e2-32de31cb060a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1724 microversion: 2.20 time: 0.389429 Jun 06 21:07:00.943013 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 122/247] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:00 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1724 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:00.973798 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2cce1955-bff3-471e-8b38-8596e61fd595 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:00.973798 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2cce1955-bff3-471e-8b38-8596e61fd595 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:00.980545 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-7277bc74-a769-4ac0-a2e4-f6321102220a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:00.981419 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-7277bc74-a769-4ac0-a2e4-f6321102220a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:00.985894 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2cce1955-bff3-471e-8b38-8596e61fd595 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:00.986669 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2cce1955-bff3-471e-8b38-8596e61fd595 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:00.988157 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2cce1955-bff3-471e-8b38-8596e61fd595 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:00.988908 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2cce1955-bff3-471e-8b38-8596e61fd595 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:00.990991 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7277bc74-a769-4ac0-a2e4-f6321102220a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:00.991446 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7277bc74-a769-4ac0-a2e4-f6321102220a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:00.996556 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7277bc74-a769-4ac0-a2e4-f6321102220a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:00.997177 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7277bc74-a769-4ac0-a2e4-f6321102220a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:01.342866 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2cce1955-bff3-471e-8b38-8596e61fd595 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:01.354313 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2cce1955-bff3-471e-8b38-8596e61fd595 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1367 microversion: 2.1 time: 0.390134 Jun 06 21:07:01.364088 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 126/248] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:00 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1367 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:01.370617 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-3f39b186-657b-4ac7-955c-5a47b977f996 req-b525fc9e-7209-4212-9dd7-81baf23a01e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a6a1d28-5f70-418f-8991-139855579e13", "tag": "20de69b0-9510-4128-a2cf-7b94f568ad57"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:07:01.400405 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-3f39b186-657b-4ac7-955c-5a47b977f996 req-b525fc9e-7209-4212-9dd7-81baf23a01e5 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:01.401039 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-3f39b186-657b-4ac7-955c-5a47b977f996 req-b525fc9e-7209-4212-9dd7-81baf23a01e5 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:01.426149 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-3f39b186-657b-4ac7-955c-5a47b977f996 req-b525fc9e-7209-4212-9dd7-81baf23a01e5 service nova] Creating event network-changed:20de69b0-9510-4128-a2cf-7b94f568ad57 for instance 8a6a1d28-5f70-418f-8991-139855579e13 on hv-cinder-84488 Jun 06 21:07:01.437816 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-3f39b186-657b-4ac7-955c-5a47b977f996 req-b525fc9e-7209-4212-9dd7-81baf23a01e5 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072054 Jun 06 21:07:01.437816 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 127/249] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:07:01.530891 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-7277bc74-a769-4ac0-a2e4-f6321102220a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:01.541393 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-7277bc74-a769-4ac0-a2e4-f6321102220a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.566084 Jun 06 21:07:01.542558 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 123/250] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:00 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:01.977286 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-83f0e284-6947-49c1-b301-d45880064424 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:01.978339 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-83f0e284-6947-49c1-b301-d45880064424 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:01.989953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-83f0e284-6947-49c1-b301-d45880064424 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:01.990548 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-83f0e284-6947-49c1-b301-d45880064424 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:01.991847 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-83f0e284-6947-49c1-b301-d45880064424 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:01.993243 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-83f0e284-6947-49c1-b301-d45880064424 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:02.155961 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-83f0e284-6947-49c1-b301-d45880064424 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:02.166231 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-83f0e284-6947-49c1-b301-d45880064424 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:02.168091 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-83f0e284-6947-49c1-b301-d45880064424 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:02.169321 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-83f0e284-6947-49c1-b301-d45880064424 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1745 microversion: 2.20 time: 0.196767 Jun 06 21:07:02.169902 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 128/251] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:01 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1745 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:02.372230 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-121357df-156c-4096-a6aa-2a6b6078db80 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:02.372927 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-121357df-156c-4096-a6aa-2a6b6078db80 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:02.380627 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-121357df-156c-4096-a6aa-2a6b6078db80 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:02.381188 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-121357df-156c-4096-a6aa-2a6b6078db80 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:02.382101 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-121357df-156c-4096-a6aa-2a6b6078db80 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:02.382560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-121357df-156c-4096-a6aa-2a6b6078db80 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:02.559710 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4a146cb4-1ef2-4f99-a5a9-aaf9e5363cd2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:02.560455 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4a146cb4-1ef2-4f99-a5a9-aaf9e5363cd2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:02.562403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-121357df-156c-4096-a6aa-2a6b6078db80 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:02.567458 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a146cb4-1ef2-4f99-a5a9-aaf9e5363cd2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:02.567984 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a146cb4-1ef2-4f99-a5a9-aaf9e5363cd2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:02.568967 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a146cb4-1ef2-4f99-a5a9-aaf9e5363cd2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:02.569587 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a146cb4-1ef2-4f99-a5a9-aaf9e5363cd2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:02.572718 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-121357df-156c-4096-a6aa-2a6b6078db80 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1367 microversion: 2.1 time: 0.204421 Jun 06 21:07:02.573599 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 124/252] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:02 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:02.747417 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4a146cb4-1ef2-4f99-a5a9-aaf9e5363cd2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:02.761722 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4a146cb4-1ef2-4f99-a5a9-aaf9e5363cd2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.205329 Jun 06 21:07:02.762483 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 129/253] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:02 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:07:03.196351 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-557b64c5-b68b-421b-8794-accff10da888 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:03.197072 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-557b64c5-b68b-421b-8794-accff10da888 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:03.206827 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-557b64c5-b68b-421b-8794-accff10da888 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:03.207356 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-557b64c5-b68b-421b-8794-accff10da888 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:03.208637 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-557b64c5-b68b-421b-8794-accff10da888 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:03.209408 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-557b64c5-b68b-421b-8794-accff10da888 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:03.454008 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-557b64c5-b68b-421b-8794-accff10da888 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:03.464760 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-557b64c5-b68b-421b-8794-accff10da888 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:03.466439 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-557b64c5-b68b-421b-8794-accff10da888 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:03.467670 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-557b64c5-b68b-421b-8794-accff10da888 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1745 microversion: 2.20 time: 0.281222 Jun 06 21:07:03.468276 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 125/254] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:03 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1745 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:03.598670 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-416ba345-9d8b-415b-a3c2-2c9c9ca12811 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:03.599285 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-416ba345-9d8b-415b-a3c2-2c9c9ca12811 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:03.607020 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-416ba345-9d8b-415b-a3c2-2c9c9ca12811 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:03.607468 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-416ba345-9d8b-415b-a3c2-2c9c9ca12811 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:03.608294 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-416ba345-9d8b-415b-a3c2-2c9c9ca12811 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:03.608734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-416ba345-9d8b-415b-a3c2-2c9c9ca12811 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:03.776994 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=2 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:03.784610 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-193adf50-b933-42cd-9641-01857e2a6861 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:03.785996 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-193adf50-b933-42cd-9641-01857e2a6861 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:03.798115 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-193adf50-b933-42cd-9641-01857e2a6861 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:03.798826 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-193adf50-b933-42cd-9641-01857e2a6861 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:03.800152 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-193adf50-b933-42cd-9641-01857e2a6861 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:03.801230 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-193adf50-b933-42cd-9641-01857e2a6861 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:03.801887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-416ba345-9d8b-415b-a3c2-2c9c9ca12811 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:03.806282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:03.835782 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-416ba345-9d8b-415b-a3c2-2c9c9ca12811 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1367 microversion: 2.1 time: 0.240484 Jun 06 21:07:03.852997 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 130/255] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:03 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:07:03.897117 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=24 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:04.047587 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-193adf50-b933-42cd-9641-01857e2a6861 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:04.078328 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-193adf50-b933-42cd-9641-01857e2a6861 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.301891 Jun 06 21:07:04.080328 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 126/256] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:03 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:07:04.497646 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-15076a71-1601-4004-bfa6-002eae6c38ce tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:04.498718 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-15076a71-1601-4004-bfa6-002eae6c38ce tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:04.507204 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-15076a71-1601-4004-bfa6-002eae6c38ce tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:04.507770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-15076a71-1601-4004-bfa6-002eae6c38ce tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:04.508736 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-15076a71-1601-4004-bfa6-002eae6c38ce tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:04.509568 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-15076a71-1601-4004-bfa6-002eae6c38ce tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:04.690178 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-15076a71-1601-4004-bfa6-002eae6c38ce tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:04.698849 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-15076a71-1601-4004-bfa6-002eae6c38ce tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:04.700343 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-15076a71-1601-4004-bfa6-002eae6c38ce tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:04.701573 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-15076a71-1601-4004-bfa6-002eae6c38ce tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1745 microversion: 2.20 time: 0.210780 Jun 06 21:07:04.702089 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 131/257] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:04 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1745 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:04.863165 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-4d9c4bf1-6574-40b6-b6f4-56c4e2705913 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:04.863800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-4d9c4bf1-6574-40b6-b6f4-56c4e2705913 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:04.871229 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4d9c4bf1-6574-40b6-b6f4-56c4e2705913 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:04.871758 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4d9c4bf1-6574-40b6-b6f4-56c4e2705913 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:04.872561 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4d9c4bf1-6574-40b6-b6f4-56c4e2705913 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:04.873021 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4d9c4bf1-6574-40b6-b6f4-56c4e2705913 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:05.074087 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-4d9c4bf1-6574-40b6-b6f4-56c4e2705913 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:05.087811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-4d9c4bf1-6574-40b6-b6f4-56c4e2705913 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1367 microversion: 2.1 time: 0.228699 Jun 06 21:07:05.089620 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 127/258] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:04 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:05.109377 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-834a8866-34ce-427b-9f57-4fdd2a6ca189 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:05.110113 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-834a8866-34ce-427b-9f57-4fdd2a6ca189 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:05.117876 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-834a8866-34ce-427b-9f57-4fdd2a6ca189 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:05.118442 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-834a8866-34ce-427b-9f57-4fdd2a6ca189 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:05.119440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-834a8866-34ce-427b-9f57-4fdd2a6ca189 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:05.119965 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-834a8866-34ce-427b-9f57-4fdd2a6ca189 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:05.299924 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-834a8866-34ce-427b-9f57-4fdd2a6ca189 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:05.317311 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-834a8866-34ce-427b-9f57-4fdd2a6ca189 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.212728 Jun 06 21:07:05.318363 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 132/259] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:05 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:05.725479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-eb9c1d89-3451-4c6e-9aa7-f18471a7ffdd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:05.726088 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-eb9c1d89-3451-4c6e-9aa7-f18471a7ffdd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:05.732925 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-eb9c1d89-3451-4c6e-9aa7-f18471a7ffdd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:05.733366 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-eb9c1d89-3451-4c6e-9aa7-f18471a7ffdd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:05.734129 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-eb9c1d89-3451-4c6e-9aa7-f18471a7ffdd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:05.734556 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-eb9c1d89-3451-4c6e-9aa7-f18471a7ffdd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:05.899209 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-eb9c1d89-3451-4c6e-9aa7-f18471a7ffdd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:05.910473 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-eb9c1d89-3451-4c6e-9aa7-f18471a7ffdd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:05.911981 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-eb9c1d89-3451-4c6e-9aa7-f18471a7ffdd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:05.913192 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-eb9c1d89-3451-4c6e-9aa7-f18471a7ffdd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1745 microversion: 2.20 time: 0.196309 Jun 06 21:07:05.913973 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 128/260] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:05 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1745 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:06.119634 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c691f84f-14e9-48ed-80ab-6de8c9008b50 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:06.121588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c691f84f-14e9-48ed-80ab-6de8c9008b50 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:06.134592 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c691f84f-14e9-48ed-80ab-6de8c9008b50 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:06.135402 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c691f84f-14e9-48ed-80ab-6de8c9008b50 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:06.136662 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c691f84f-14e9-48ed-80ab-6de8c9008b50 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:06.137351 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c691f84f-14e9-48ed-80ab-6de8c9008b50 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:06.314309 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c691f84f-14e9-48ed-80ab-6de8c9008b50 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:06.323922 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c691f84f-14e9-48ed-80ab-6de8c9008b50 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1367 microversion: 2.1 time: 0.213483 Jun 06 21:07:06.325122 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 133/261] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:06 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:06.337195 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-015d85ec-ddfe-4768-a322-cea17d244814 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:06.338000 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-015d85ec-ddfe-4768-a322-cea17d244814 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:06.346731 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-015d85ec-ddfe-4768-a322-cea17d244814 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:06.347349 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-015d85ec-ddfe-4768-a322-cea17d244814 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:06.348331 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-015d85ec-ddfe-4768-a322-cea17d244814 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:06.348908 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-015d85ec-ddfe-4768-a322-cea17d244814 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:06.680717 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-015d85ec-ddfe-4768-a322-cea17d244814 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:06.692154 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-015d85ec-ddfe-4768-a322-cea17d244814 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.359577 Jun 06 21:07:06.703180 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 129/262] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:06 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:06.934225 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4d318b97-10fe-4f10-9848-32d3ace32cc2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:06.934961 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4d318b97-10fe-4f10-9848-32d3ace32cc2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:06.941565 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4d318b97-10fe-4f10-9848-32d3ace32cc2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:06.942009 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4d318b97-10fe-4f10-9848-32d3ace32cc2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:06.942797 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4d318b97-10fe-4f10-9848-32d3ace32cc2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:06.943225 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4d318b97-10fe-4f10-9848-32d3ace32cc2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:07.162156 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4d318b97-10fe-4f10-9848-32d3ace32cc2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:07.184169 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4d318b97-10fe-4f10-9848-32d3ace32cc2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:07.186051 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4d318b97-10fe-4f10-9848-32d3ace32cc2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:07.187348 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4d318b97-10fe-4f10-9848-32d3ace32cc2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1745 microversion: 2.20 time: 0.257848 Jun 06 21:07:07.192097 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 134/263] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:06 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1745 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:07.350832 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-c806b479-f6de-49a0-a907-99cb31dc53a7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:07.351418 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-c806b479-f6de-49a0-a907-99cb31dc53a7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:07.364355 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c806b479-f6de-49a0-a907-99cb31dc53a7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:07.365365 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c806b479-f6de-49a0-a907-99cb31dc53a7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:07.367691 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c806b479-f6de-49a0-a907-99cb31dc53a7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:07.368495 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c806b479-f6de-49a0-a907-99cb31dc53a7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:07.668938 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c806b479-f6de-49a0-a907-99cb31dc53a7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:07.709909 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-21906c53-d40e-4e0a-b7f6-932dd4d4563d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:07.710975 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-21906c53-d40e-4e0a-b7f6-932dd4d4563d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:07.737150 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-21906c53-d40e-4e0a-b7f6-932dd4d4563d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:07.737598 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-21906c53-d40e-4e0a-b7f6-932dd4d4563d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:07.746104 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-21906c53-d40e-4e0a-b7f6-932dd4d4563d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:07.749374 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-21906c53-d40e-4e0a-b7f6-932dd4d4563d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:07.755595 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-c806b479-f6de-49a0-a907-99cb31dc53a7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1367 microversion: 2.1 time: 0.407203 Jun 06 21:07:07.757677 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 130/264] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:07 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1367 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:08.187514 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-21906c53-d40e-4e0a-b7f6-932dd4d4563d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:08.197152 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-21906c53-d40e-4e0a-b7f6-932dd4d4563d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.491491 Jun 06 21:07:08.198270 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 135/265] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:07 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:07:08.217652 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2c7b1d8b-ba55-4ce2-ad16-eafa9d949192 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:08.218274 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-2c7b1d8b-ba55-4ce2-ad16-eafa9d949192 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:08.227985 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2c7b1d8b-ba55-4ce2-ad16-eafa9d949192 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:08.228579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2c7b1d8b-ba55-4ce2-ad16-eafa9d949192 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:08.231070 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2c7b1d8b-ba55-4ce2-ad16-eafa9d949192 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:08.231572 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2c7b1d8b-ba55-4ce2-ad16-eafa9d949192 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:08.529141 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2c7b1d8b-ba55-4ce2-ad16-eafa9d949192 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:08.538826 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=100 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:08.542975 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2c7b1d8b-ba55-4ce2-ad16-eafa9d949192 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:08.546666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2c7b1d8b-ba55-4ce2-ad16-eafa9d949192 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:08.548380 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-2c7b1d8b-ba55-4ce2-ad16-eafa9d949192 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1740 microversion: 2.20 time: 0.337096 Jun 06 21:07:08.561977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 131/266] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:08 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1740 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:08.580338 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-fc44d883-ffec-4172-85dc-a26bec1f9993 req-eaf64e8b-6a9f-435f-9f3e-f9daada525a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1886e3bf-c735-4f91-8a2f-0bc6996982e0", "name": "network-vif-plugged", "status": "completed", "tag": "2e4dc91b-9fa1-4ca1-9827-0ca3ef02a18e"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:07:08.595220 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-fc44d883-ffec-4172-85dc-a26bec1f9993 req-eaf64e8b-6a9f-435f-9f3e-f9daada525a7 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:08.596136 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-fc44d883-ffec-4172-85dc-a26bec1f9993 req-eaf64e8b-6a9f-435f-9f3e-f9daada525a7 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:08.615979 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-fc44d883-ffec-4172-85dc-a26bec1f9993 req-eaf64e8b-6a9f-435f-9f3e-f9daada525a7 service nova] Creating event network-vif-plugged:2e4dc91b-9fa1-4ca1-9827-0ca3ef02a18e for instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 on hv-cinder-84488 Jun 06 21:07:08.625550 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-fc44d883-ffec-4172-85dc-a26bec1f9993 req-eaf64e8b-6a9f-435f-9f3e-f9daada525a7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052096 Jun 06 21:07:08.626981 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 136/267] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:07:08.777729 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-5fe4927b-1803-43d5-b63c-316c3c5876eb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:08.779674 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-5fe4927b-1803-43d5-b63c-316c3c5876eb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:08.800882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5fe4927b-1803-43d5-b63c-316c3c5876eb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:08.801641 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5fe4927b-1803-43d5-b63c-316c3c5876eb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:08.803269 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5fe4927b-1803-43d5-b63c-316c3c5876eb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:08.804609 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5fe4927b-1803-43d5-b63c-316c3c5876eb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:09.139159 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-5fe4927b-1803-43d5-b63c-316c3c5876eb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:09.156968 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-5fe4927b-1803-43d5-b63c-316c3c5876eb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1367 microversion: 2.1 time: 0.384131 Jun 06 21:07:09.172167 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 132/268] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:08 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1367 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:09.215917 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-99791141-4bce-45f2-8840-f5a341be45cf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:09.216537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-99791141-4bce-45f2-8840-f5a341be45cf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:09.231562 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-99791141-4bce-45f2-8840-f5a341be45cf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:09.232054 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-99791141-4bce-45f2-8840-f5a341be45cf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:09.232872 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-99791141-4bce-45f2-8840-f5a341be45cf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:09.233307 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-99791141-4bce-45f2-8840-f5a341be45cf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:09.403544 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e84041b5-30c6-45d3-adfc-3b59a3aeae34 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1471702101", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1736120711", "security_groups": [{"name": "tempest-secgroup-smoke-1252162369"}], "block_device_mapping_v2": [{"uuid": "f9c9f2d9-9d48-4ecf-95b9-bb5171bdff79", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "69481f95-9f4b-4266-9f41-2bc9333f7236"}]}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:07:09.623214 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.network.neutron [None req-e84041b5-30c6-45d3-adfc-3b59a3aeae34 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] validate_networks() for [('69481f95-9f4b-4266-9f41-2bc9333f7236', None, None, None, None, None)] {{(pid=117860) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 21:07:09.710036 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-99791141-4bce-45f2-8840-f5a341be45cf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:09.723707 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-99791141-4bce-45f2-8840-f5a341be45cf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.511444 Jun 06 21:07:09.734722 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 137/269] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:09 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:09.742751 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6c30b81f-def1-4930-a998-2e1f1ce7cb5c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:09.743360 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6c30b81f-def1-4930-a998-2e1f1ce7cb5c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:09.759029 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=84 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:09.762204 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6c30b81f-def1-4930-a998-2e1f1ce7cb5c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:09.763076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6c30b81f-def1-4930-a998-2e1f1ce7cb5c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:09.763933 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6c30b81f-def1-4930-a998-2e1f1ce7cb5c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:09.764405 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6c30b81f-def1-4930-a998-2e1f1ce7cb5c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:10.170556 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6c30b81f-def1-4930-a998-2e1f1ce7cb5c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:10.186933 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6c30b81f-def1-4930-a998-2e1f1ce7cb5c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:10.195889 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6c30b81f-def1-4930-a998-2e1f1ce7cb5c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:10.197238 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6c30b81f-def1-4930-a998-2e1f1ce7cb5c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1740 microversion: 2.20 time: 0.461771 Jun 06 21:07:10.211673 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 138/270] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:09 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1740 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:10.229432 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c9daf413-953a-496b-bc92-a47ce846d2fe tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:10.230276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c9daf413-953a-496b-bc92-a47ce846d2fe tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:10.256366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c9daf413-953a-496b-bc92-a47ce846d2fe tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:10.257569 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c9daf413-953a-496b-bc92-a47ce846d2fe tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:10.258739 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c9daf413-953a-496b-bc92-a47ce846d2fe tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:10.259521 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c9daf413-953a-496b-bc92-a47ce846d2fe tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:10.486434 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-e84041b5-30c6-45d3-adfc-3b59a3aeae34 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Flavor limits 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 21:07:10.487887 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-e84041b5-30c6-45d3-adfc-3b59a3aeae34 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Image limits 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 21:07:10.488835 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-e84041b5-30c6-45d3-adfc-3b59a3aeae34 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Flavor pref 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 21:07:10.489722 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-e84041b5-30c6-45d3-adfc-3b59a3aeae34 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Image pref 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 21:07:10.492258 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-e84041b5-30c6-45d3-adfc-3b59a3aeae34 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 21:07:10.526807 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e84041b5-30c6-45d3-adfc-3b59a3aeae34 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:10.527537 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e84041b5-30c6-45d3-adfc-3b59a3aeae34 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:10.529705 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e84041b5-30c6-45d3-adfc-3b59a3aeae34 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:10.531154 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e84041b5-30c6-45d3-adfc-3b59a3aeae34 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:10.561139 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-e84041b5-30c6-45d3-adfc-3b59a3aeae34 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Getting quotas for project 370f0df7dc4745edb578a5f922c0f57f. Resources: {'ram', 'cores', 'instances'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:07:10.568027 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c9daf413-953a-496b-bc92-a47ce846d2fe tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:10.569202 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-e84041b5-30c6-45d3-adfc-3b59a3aeae34 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Getting quotas for user 67481128d30049d29d5f0e66b1a4c970 and project 370f0df7dc4745edb578a5f922c0f57f. Resources: {'ram', 'cores', 'instances'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:07:10.577175 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c9daf413-953a-496b-bc92-a47ce846d2fe tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1367 microversion: 2.1 time: 0.364283 Jun 06 21:07:10.591560 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 139/271] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:10 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1367 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:10.697150 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-e84041b5-30c6-45d3-adfc-3b59a3aeae34 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Going to run 1 instances... {{(pid=117860) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 21:07:10.700909 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-e84041b5-30c6-45d3-adfc-3b59a3aeae34 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f9c9f2d9-9d48-4ecf-95b9-bb5171bdff79',volume_size=None,volume_type=None)] {{(pid=117860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 21:07:10.742689 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0f880771-022f-4626-95e4-3659eedd4e2e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:10.743436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0f880771-022f-4626-95e4-3659eedd4e2e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:10.763401 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f880771-022f-4626-95e4-3659eedd4e2e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:10.768973 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f880771-022f-4626-95e4-3659eedd4e2e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:10.770824 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f880771-022f-4626-95e4-3659eedd4e2e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:10.771292 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f880771-022f-4626-95e4-3659eedd4e2e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:11.003744 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-e84041b5-30c6-45d3-adfc-3b59a3aeae34 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.604480 Jun 06 21:07:11.005864 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 133/272] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 6 21:07:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 1608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 21:07:11.019667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-f0f5021d-ee06-44f5-94c5-14346d39027d tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:11.021453 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-f0f5021d-ee06-44f5-94c5-14346d39027d tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:11.141485 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-f0f5021d-ee06-44f5-94c5-14346d39027d tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:11.153291 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-f0f5021d-ee06-44f5-94c5-14346d39027d tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1095 microversion: 2.1 time: 0.139594 Jun 06 21:07:11.153904 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 134/273] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:11 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1095 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:07:11.232503 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-37aa7495-514a-4589-b30a-f8a26ea3e6dd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:11.233631 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-37aa7495-514a-4589-b30a-f8a26ea3e6dd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:11.244578 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-37aa7495-514a-4589-b30a-f8a26ea3e6dd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:11.245241 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-37aa7495-514a-4589-b30a-f8a26ea3e6dd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:11.246465 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-37aa7495-514a-4589-b30a-f8a26ea3e6dd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:11.247284 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-37aa7495-514a-4589-b30a-f8a26ea3e6dd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:11.306021 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0f880771-022f-4626-95e4-3659eedd4e2e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:11.316742 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0f880771-022f-4626-95e4-3659eedd4e2e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.578892 Jun 06 21:07:11.326731 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 140/274] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:10 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:11.523314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-37aa7495-514a-4589-b30a-f8a26ea3e6dd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:11.541880 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-37aa7495-514a-4589-b30a-f8a26ea3e6dd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:11.552955 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-37aa7495-514a-4589-b30a-f8a26ea3e6dd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:11.560382 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-37aa7495-514a-4589-b30a-f8a26ea3e6dd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1740 microversion: 2.20 time: 0.333723 Jun 06 21:07:11.566910 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 135/275] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:11 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1740 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:11.597940 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-41d4e3a9-2b61-46bc-bf77-d3f972c5ceaa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:11.599861 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-41d4e3a9-2b61-46bc-bf77-d3f972c5ceaa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:11.610649 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-41d4e3a9-2b61-46bc-bf77-d3f972c5ceaa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:11.613767 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-41d4e3a9-2b61-46bc-bf77-d3f972c5ceaa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:11.614890 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-41d4e3a9-2b61-46bc-bf77-d3f972c5ceaa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:11.617786 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-41d4e3a9-2b61-46bc-bf77-d3f972c5ceaa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:12.138369 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-41d4e3a9-2b61-46bc-bf77-d3f972c5ceaa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:12.173124 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-87df7157-2f6e-40ec-b574-3e80455e67af tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:12.175146 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-87df7157-2f6e-40ec-b574-3e80455e67af tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:12.191607 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-87df7157-2f6e-40ec-b574-3e80455e67af tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:12.192446 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-87df7157-2f6e-40ec-b574-3e80455e67af tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:12.196764 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-87df7157-2f6e-40ec-b574-3e80455e67af tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:12.197400 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-87df7157-2f6e-40ec-b574-3e80455e67af tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:12.217844 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-41d4e3a9-2b61-46bc-bf77-d3f972c5ceaa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1367 microversion: 2.1 time: 0.621374 Jun 06 21:07:12.263341 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 141/276] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:11 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1367 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:12.344133 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-db3b69a6-62e2-41eb-b18d-19bfd7da5fd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:12.344875 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-db3b69a6-62e2-41eb-b18d-19bfd7da5fd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:12.358256 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-db3b69a6-62e2-41eb-b18d-19bfd7da5fd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:12.361196 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-db3b69a6-62e2-41eb-b18d-19bfd7da5fd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:12.362453 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-db3b69a6-62e2-41eb-b18d-19bfd7da5fd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:12.363125 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-db3b69a6-62e2-41eb-b18d-19bfd7da5fd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:12.774157 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-db3b69a6-62e2-41eb-b18d-19bfd7da5fd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:12.787692 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-db3b69a6-62e2-41eb-b18d-19bfd7da5fd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.447315 Jun 06 21:07:12.788584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 142/277] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:12 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:12.804472 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6232b523-513b-47fb-994b-10920e4010c6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:12.805411 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6232b523-513b-47fb-994b-10920e4010c6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:12.819565 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-87df7157-2f6e-40ec-b574-3e80455e67af tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:12.820631 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6232b523-513b-47fb-994b-10920e4010c6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:12.821262 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6232b523-513b-47fb-994b-10920e4010c6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:12.822027 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6232b523-513b-47fb-994b-10920e4010c6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:12.822695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6232b523-513b-47fb-994b-10920e4010c6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:12.834874 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-87df7157-2f6e-40ec-b574-3e80455e67af tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1137 microversion: 2.1 time: 0.667749 Jun 06 21:07:12.836156 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 136/278] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:12 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1137 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:12.845337 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-3a53f6c4-e6f8-44cb-9948-4df0f84c5f09 req-c8f37b67-6c2c-4998-891b-36d861037bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a6a1d28-5f70-418f-8991-139855579e13", "name": "network-vif-plugged", "status": "completed", "tag": "20de69b0-9510-4128-a2cf-7b94f568ad57"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:07:12.866457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-3a53f6c4-e6f8-44cb-9948-4df0f84c5f09 req-c8f37b67-6c2c-4998-891b-36d861037bb8 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:12.867738 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-3a53f6c4-e6f8-44cb-9948-4df0f84c5f09 req-c8f37b67-6c2c-4998-891b-36d861037bb8 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:12.894766 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-3a53f6c4-e6f8-44cb-9948-4df0f84c5f09 req-c8f37b67-6c2c-4998-891b-36d861037bb8 service nova] Creating event network-vif-plugged:20de69b0-9510-4128-a2cf-7b94f568ad57 for instance 8a6a1d28-5f70-418f-8991-139855579e13 on hv-cinder-84488 Jun 06 21:07:12.909522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-3a53f6c4-e6f8-44cb-9948-4df0f84c5f09 req-c8f37b67-6c2c-4998-891b-36d861037bb8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071704 Jun 06 21:07:12.910252 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 137/279] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:07:13.217865 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6232b523-513b-47fb-994b-10920e4010c6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:13.227408 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6232b523-513b-47fb-994b-10920e4010c6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:13.237045 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6232b523-513b-47fb-994b-10920e4010c6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:13.249635 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6232b523-513b-47fb-994b-10920e4010c6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1740 microversion: 2.20 time: 0.446090 Jun 06 21:07:13.268112 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 143/280] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:12 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1740 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:13.275696 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-603337f6-2147-43fb-ac9a-a5843f90f450 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:13.277323 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-603337f6-2147-43fb-ac9a-a5843f90f450 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:13.294686 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-603337f6-2147-43fb-ac9a-a5843f90f450 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:13.295505 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-603337f6-2147-43fb-ac9a-a5843f90f450 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:13.297328 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-603337f6-2147-43fb-ac9a-a5843f90f450 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:13.298082 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-603337f6-2147-43fb-ac9a-a5843f90f450 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:13.702361 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-603337f6-2147-43fb-ac9a-a5843f90f450 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:13.728799 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-603337f6-2147-43fb-ac9a-a5843f90f450 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1367 microversion: 2.1 time: 0.472402 Jun 06 21:07:13.736620 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 138/281] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:13 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1367 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:13.806545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3223bdc1-e983-4aac-ad92-4d32ac367a4f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:13.809518 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3223bdc1-e983-4aac-ad92-4d32ac367a4f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:13.825341 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3223bdc1-e983-4aac-ad92-4d32ac367a4f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:13.826709 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3223bdc1-e983-4aac-ad92-4d32ac367a4f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:13.827763 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3223bdc1-e983-4aac-ad92-4d32ac367a4f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:13.828407 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3223bdc1-e983-4aac-ad92-4d32ac367a4f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:13.853947 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-a9790490-c22e-44af-b415-b8ddfe708f0e tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:13.855268 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-a9790490-c22e-44af-b415-b8ddfe708f0e tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:13.867003 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a9790490-c22e-44af-b415-b8ddfe708f0e tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:13.874583 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a9790490-c22e-44af-b415-b8ddfe708f0e tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:13.875914 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a9790490-c22e-44af-b415-b8ddfe708f0e tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:13.876558 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a9790490-c22e-44af-b415-b8ddfe708f0e tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:14.198342 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3223bdc1-e983-4aac-ad92-4d32ac367a4f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:14.207801 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3223bdc1-e983-4aac-ad92-4d32ac367a4f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.405676 Jun 06 21:07:14.209063 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-a9790490-c22e-44af-b415-b8ddfe708f0e tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:14.216589 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 144/282] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:13 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:14.219624 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-a9790490-c22e-44af-b415-b8ddfe708f0e tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1211 microversion: 2.1 time: 0.370948 Jun 06 21:07:14.234374 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 139/283] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:13 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1211 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:14.272605 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f806d665-77af-455f-a9a9-4f1247ff061e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:14.278497 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f806d665-77af-455f-a9a9-4f1247ff061e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:14.286575 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f806d665-77af-455f-a9a9-4f1247ff061e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:14.296364 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f806d665-77af-455f-a9a9-4f1247ff061e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:14.297651 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f806d665-77af-455f-a9a9-4f1247ff061e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:14.298374 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f806d665-77af-455f-a9a9-4f1247ff061e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:14.656216 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f806d665-77af-455f-a9a9-4f1247ff061e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:14.667603 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f806d665-77af-455f-a9a9-4f1247ff061e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:14.670315 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f806d665-77af-455f-a9a9-4f1247ff061e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:14.671879 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f806d665-77af-455f-a9a9-4f1247ff061e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1740 microversion: 2.20 time: 0.403962 Jun 06 21:07:14.686056 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 145/284] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:14 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1740 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:14.769721 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b815686f-0412-4b5a-b9f2-7d4922335761 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:14.770408 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-b815686f-0412-4b5a-b9f2-7d4922335761 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:14.786193 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b815686f-0412-4b5a-b9f2-7d4922335761 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:14.787305 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b815686f-0412-4b5a-b9f2-7d4922335761 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:14.788622 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b815686f-0412-4b5a-b9f2-7d4922335761 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:14.789415 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b815686f-0412-4b5a-b9f2-7d4922335761 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:15.246509 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a4a6736e-4a77-49df-be9c-9a49ff587d2a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:15.252290 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a4a6736e-4a77-49df-be9c-9a49ff587d2a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:15.281263 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a4a6736e-4a77-49df-be9c-9a49ff587d2a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:15.282479 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a4a6736e-4a77-49df-be9c-9a49ff587d2a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:15.290908 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a4a6736e-4a77-49df-be9c-9a49ff587d2a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:15.293028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a4a6736e-4a77-49df-be9c-9a49ff587d2a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:15.559147 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a4a6736e-4a77-49df-be9c-9a49ff587d2a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:15.572081 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a4a6736e-4a77-49df-be9c-9a49ff587d2a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.341835 Jun 06 21:07:15.576211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 146/285] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:15 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:15.581598 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c629150b-5eee-4795-a2fd-be5423cbfef1 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:15.582217 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c629150b-5eee-4795-a2fd-be5423cbfef1 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:15.622634 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c629150b-5eee-4795-a2fd-be5423cbfef1 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:15.625175 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c629150b-5eee-4795-a2fd-be5423cbfef1 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:15.628278 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c629150b-5eee-4795-a2fd-be5423cbfef1 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:15.630895 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c629150b-5eee-4795-a2fd-be5423cbfef1 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:15.903346 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c629150b-5eee-4795-a2fd-be5423cbfef1 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:15.911746 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-b815686f-0412-4b5a-b9f2-7d4922335761 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:15.916751 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c629150b-5eee-4795-a2fd-be5423cbfef1 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1199 microversion: 2.1 time: 0.338621 Jun 06 21:07:15.919217 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 147/286] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:15 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1199 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:15.949948 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-b815686f-0412-4b5a-b9f2-7d4922335761 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1367 microversion: 2.1 time: 1.187581 Jun 06 21:07:15.956725 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 140/287] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:14 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1367 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:15.961597 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7823de3d-8656-4997-9147-b4e2a0b3fa0e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:15.963104 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7823de3d-8656-4997-9147-b4e2a0b3fa0e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:15.987428 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7823de3d-8656-4997-9147-b4e2a0b3fa0e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:15.987428 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7823de3d-8656-4997-9147-b4e2a0b3fa0e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:15.989851 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7823de3d-8656-4997-9147-b4e2a0b3fa0e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:15.990288 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7823de3d-8656-4997-9147-b4e2a0b3fa0e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:16.011580 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:16.509749 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7823de3d-8656-4997-9147-b4e2a0b3fa0e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:16.530598 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7823de3d-8656-4997-9147-b4e2a0b3fa0e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:16.535854 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7823de3d-8656-4997-9147-b4e2a0b3fa0e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:16.544556 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7823de3d-8656-4997-9147-b4e2a0b3fa0e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1740 microversion: 2.20 time: 0.590930 Jun 06 21:07:16.545558 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 148/288] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:15 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1740 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:16.594229 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-41678af3-3fa6-470e-a6a9-bfea6ab64c98 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:16.594956 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-41678af3-3fa6-470e-a6a9-bfea6ab64c98 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:16.625479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-41678af3-3fa6-470e-a6a9-bfea6ab64c98 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:16.625921 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-41678af3-3fa6-470e-a6a9-bfea6ab64c98 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:16.626741 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-41678af3-3fa6-470e-a6a9-bfea6ab64c98 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:16.628171 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-41678af3-3fa6-470e-a6a9-bfea6ab64c98 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:16.954714 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-35c2907d-47ba-4c3c-8b22-aad143f02477 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:16.957737 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-35c2907d-47ba-4c3c-8b22-aad143f02477 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:17.012243 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-35c2907d-47ba-4c3c-8b22-aad143f02477 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:17.014090 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-35c2907d-47ba-4c3c-8b22-aad143f02477 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:17.018075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-35c2907d-47ba-4c3c-8b22-aad143f02477 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:17.018650 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-35c2907d-47ba-4c3c-8b22-aad143f02477 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:17.357218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-41678af3-3fa6-470e-a6a9-bfea6ab64c98 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:17.367679 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-41678af3-3fa6-470e-a6a9-bfea6ab64c98 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1520 microversion: 2.1 time: 0.781322 Jun 06 21:07:17.375201 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 141/289] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:16 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1520 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:17.387836 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-9fc85b2f-9aa6-4e1c-9cad-734a972583d1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:17.388610 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-9fc85b2f-9aa6-4e1c-9cad-734a972583d1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:17.405753 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9fc85b2f-9aa6-4e1c-9cad-734a972583d1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:17.410364 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9fc85b2f-9aa6-4e1c-9cad-734a972583d1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:17.411643 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9fc85b2f-9aa6-4e1c-9cad-734a972583d1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:17.412331 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9fc85b2f-9aa6-4e1c-9cad-734a972583d1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:17.424586 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-35c2907d-47ba-4c3c-8b22-aad143f02477 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:17.435713 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-35c2907d-47ba-4c3c-8b22-aad143f02477 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1267 microversion: 2.1 time: 0.494157 Jun 06 21:07:17.446463 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 149/290] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:16 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1267 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:17.571071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c9d5d814-05c4-460c-a092-bf7ad0e7f319 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:17.575024 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c9d5d814-05c4-460c-a092-bf7ad0e7f319 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:17.591497 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c9d5d814-05c4-460c-a092-bf7ad0e7f319 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:17.593455 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c9d5d814-05c4-460c-a092-bf7ad0e7f319 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:17.595100 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c9d5d814-05c4-460c-a092-bf7ad0e7f319 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:17.596578 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c9d5d814-05c4-460c-a092-bf7ad0e7f319 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:18.031686 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-9fc85b2f-9aa6-4e1c-9cad-734a972583d1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:18.087124 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-9fc85b2f-9aa6-4e1c-9cad-734a972583d1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1367 microversion: 2.1 time: 0.709621 Jun 06 21:07:18.094312 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 142/291] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:17 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1367 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:18.142524 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c9d5d814-05c4-460c-a092-bf7ad0e7f319 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:18.179793 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c9d5d814-05c4-460c-a092-bf7ad0e7f319 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:18.188104 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c9d5d814-05c4-460c-a092-bf7ad0e7f319 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:18.200144 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c9d5d814-05c4-460c-a092-bf7ad0e7f319 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1740 microversion: 2.20 time: 0.637470 Jun 06 21:07:18.211848 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 150/292] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:17 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1740 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:07:18.394465 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-5a8c2bf0-c5c7-4c11-ae7f-59e0a720f7d6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:18.396218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-5a8c2bf0-c5c7-4c11-ae7f-59e0a720f7d6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:18.432274 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5a8c2bf0-c5c7-4c11-ae7f-59e0a720f7d6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:18.433779 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5a8c2bf0-c5c7-4c11-ae7f-59e0a720f7d6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:18.441730 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5a8c2bf0-c5c7-4c11-ae7f-59e0a720f7d6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:18.443097 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5a8c2bf0-c5c7-4c11-ae7f-59e0a720f7d6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:18.462697 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5d9c12f7-4aff-4d11-b1b2-26cc864ec2fd tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:18.470440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5d9c12f7-4aff-4d11-b1b2-26cc864ec2fd tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:18.497854 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5d9c12f7-4aff-4d11-b1b2-26cc864ec2fd tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:18.498654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5d9c12f7-4aff-4d11-b1b2-26cc864ec2fd tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:18.514712 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5d9c12f7-4aff-4d11-b1b2-26cc864ec2fd tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:18.515523 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5d9c12f7-4aff-4d11-b1b2-26cc864ec2fd tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:19.012644 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5d9c12f7-4aff-4d11-b1b2-26cc864ec2fd tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:19.024338 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5d9c12f7-4aff-4d11-b1b2-26cc864ec2fd tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1267 microversion: 2.1 time: 0.568911 Jun 06 21:07:19.043102 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 151/293] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:18 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1267 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:19.124239 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-398c7f1c-0ba3-4706-9b9e-4c53b234f5e0 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:19.125130 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-398c7f1c-0ba3-4706-9b9e-4c53b234f5e0 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:19.145076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-398c7f1c-0ba3-4706-9b9e-4c53b234f5e0 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:19.145786 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-398c7f1c-0ba3-4706-9b9e-4c53b234f5e0 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:19.147720 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-398c7f1c-0ba3-4706-9b9e-4c53b234f5e0 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:19.150944 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-398c7f1c-0ba3-4706-9b9e-4c53b234f5e0 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:19.599062 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-398c7f1c-0ba3-4706-9b9e-4c53b234f5e0 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:19.631093 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-398c7f1c-0ba3-4706-9b9e-4c53b234f5e0 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1558 microversion: 2.1 time: 0.511113 Jun 06 21:07:19.632638 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 152/294] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:19 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1558 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:19.653078 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2d16a74f-5283-43da-8d72-9479ad32148b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:19.657980 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2d16a74f-5283-43da-8d72-9479ad32148b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:19.675709 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2d16a74f-5283-43da-8d72-9479ad32148b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:19.678527 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2d16a74f-5283-43da-8d72-9479ad32148b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:19.679611 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2d16a74f-5283-43da-8d72-9479ad32148b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:19.683540 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2d16a74f-5283-43da-8d72-9479ad32148b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:19.894763 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-5a8c2bf0-c5c7-4c11-ae7f-59e0a720f7d6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:19.945753 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-5a8c2bf0-c5c7-4c11-ae7f-59e0a720f7d6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1500 microversion: 2.1 time: 1.542145 Jun 06 21:07:19.961568 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 143/295] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:18 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1500 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:19.986588 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-9a143e26-2b9a-43bb-82b2-0a757c7ce9bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:20.012023 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-9a143e26-2b9a-43bb-82b2-0a757c7ce9bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:20.061718 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9a143e26-2b9a-43bb-82b2-0a757c7ce9bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:20.068908 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9a143e26-2b9a-43bb-82b2-0a757c7ce9bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:20.071817 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9a143e26-2b9a-43bb-82b2-0a757c7ce9bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:20.072597 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9a143e26-2b9a-43bb-82b2-0a757c7ce9bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:20.147910 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2d16a74f-5283-43da-8d72-9479ad32148b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:20.163936 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2d16a74f-5283-43da-8d72-9479ad32148b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:20.165496 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2d16a74f-5283-43da-8d72-9479ad32148b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:20.166855 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2d16a74f-5283-43da-8d72-9479ad32148b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1740 microversion: 2.20 time: 0.532912 Jun 06 21:07:20.171721 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 153/296] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:19 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1740 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:20.180868 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-12f5637b-5246-4930-b430-ba379ee894aa tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:20.189097 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-12f5637b-5246-4930-b430-ba379ee894aa tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:20.211176 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-12f5637b-5246-4930-b430-ba379ee894aa tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:20.212526 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-12f5637b-5246-4930-b430-ba379ee894aa tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:20.220113 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-12f5637b-5246-4930-b430-ba379ee894aa tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:20.220603 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-12f5637b-5246-4930-b430-ba379ee894aa tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:20.432892 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-9a143e26-2b9a-43bb-82b2-0a757c7ce9bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.468067 Jun 06 21:07:20.433982 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 144/297] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jun 6 21:07:19 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13/os-interface => generated 285 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:07:20.452097 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-90f9faed-6c8d-4e0f-a325-825cfe2c8593 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:20.452770 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-90f9faed-6c8d-4e0f-a325-825cfe2c8593 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:20.480470 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-90f9faed-6c8d-4e0f-a325-825cfe2c8593 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:20.481004 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-90f9faed-6c8d-4e0f-a325-825cfe2c8593 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:20.483059 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-90f9faed-6c8d-4e0f-a325-825cfe2c8593 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:20.483500 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-90f9faed-6c8d-4e0f-a325-825cfe2c8593 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:20.634720 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=2 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:21.146615 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=8 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:21.634878 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-90f9faed-6c8d-4e0f-a325-825cfe2c8593 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:21.642775 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-12f5637b-5246-4930-b430-ba379ee894aa tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:21.655141 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-12f5637b-5246-4930-b430-ba379ee894aa tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1514 microversion: 2.1 time: 1.482108 Jun 06 21:07:21.665265 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-90f9faed-6c8d-4e0f-a325-825cfe2c8593 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1267 microversion: 2.1 time: 1.227593 Jun 06 21:07:21.675026 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 145/298] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:20 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1267 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:21.692979 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 154/299] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:20 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1514 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:21.717553 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-cd0a796c-56df-498b-b634-9a1037010524 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:21.718586 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-cd0a796c-56df-498b-b634-9a1037010524 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:21.729823 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-cd0a796c-56df-498b-b634-9a1037010524 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:21.730570 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-cd0a796c-56df-498b-b634-9a1037010524 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:21.731905 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-cd0a796c-56df-498b-b634-9a1037010524 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:21.732635 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-cd0a796c-56df-498b-b634-9a1037010524 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:22.001908 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-b5a92ff0-9a02-481c-bb53-8a99ed9ade6a req-4da110d6-8a08-4750-b957-210e05ba9d78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56edbb7a-b8fb-4934-a7f5-9f2cf82542a3", "tag": "0e363b5d-cbf1-4fca-be7e-728a1e94a07d"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:07:22.040254 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-b5a92ff0-9a02-481c-bb53-8a99ed9ade6a req-4da110d6-8a08-4750-b957-210e05ba9d78 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:22.046164 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-b5a92ff0-9a02-481c-bb53-8a99ed9ade6a req-4da110d6-8a08-4750-b957-210e05ba9d78 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:22.151792 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-b5a92ff0-9a02-481c-bb53-8a99ed9ade6a req-4da110d6-8a08-4750-b957-210e05ba9d78 service nova] Creating event network-changed:0e363b5d-cbf1-4fca-be7e-728a1e94a07d for instance 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 on hv-cinder-84488 Jun 06 21:07:22.183093 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-b5a92ff0-9a02-481c-bb53-8a99ed9ade6a req-4da110d6-8a08-4750-b957-210e05ba9d78 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179280 Jun 06 21:07:22.188594 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 155/300] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:07:22.685603 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-cf5cb02d-7242-44b1-96e3-bc7577bce404 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:22.686465 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-cf5cb02d-7242-44b1-96e3-bc7577bce404 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:22.706179 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf5cb02d-7242-44b1-96e3-bc7577bce404 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:22.706646 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf5cb02d-7242-44b1-96e3-bc7577bce404 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:22.707471 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf5cb02d-7242-44b1-96e3-bc7577bce404 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:22.707905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf5cb02d-7242-44b1-96e3-bc7577bce404 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:22.984440 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-cd0a796c-56df-498b-b634-9a1037010524 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:22.995748 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-cd0a796c-56df-498b-b634-9a1037010524 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:23.002816 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-cd0a796c-56df-498b-b634-9a1037010524 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:23.008853 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-cd0a796c-56df-498b-b634-9a1037010524 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1740 microversion: 2.20 time: 1.338749 Jun 06 21:07:23.011732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 146/301] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:21 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1740 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:23.394308 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-cf5cb02d-7242-44b1-96e3-bc7577bce404 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:23.403221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-cf5cb02d-7242-44b1-96e3-bc7577bce404 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1267 microversion: 2.1 time: 0.723016 Jun 06 21:07:23.408250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 156/302] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:22 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1267 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:23.807534 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-69963910-f41e-45fb-843a-834248500351 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:07:23.808745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-69963910-f41e-45fb-843a-834248500351 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:23.824163 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-69963910-f41e-45fb-843a-834248500351 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:23.826440 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-69963910-f41e-45fb-843a-834248500351 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:23.829344 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-69963910-f41e-45fb-843a-834248500351 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:23.830141 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-69963910-f41e-45fb-843a-834248500351 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:23.943604 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.objects.instance [None req-69963910-f41e-45fb-843a-834248500351 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lazy-loading 'flavor' on Instance uuid 9258ebef-e9e5-47b9-84b9-d02803d028b1 {{(pid=117860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:07:24.032540 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-63e4fce7-711f-4dcf-ad6e-90f0785f943f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:24.034057 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-63e4fce7-711f-4dcf-ad6e-90f0785f943f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:24.058218 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-63e4fce7-711f-4dcf-ad6e-90f0785f943f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:24.059460 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-63e4fce7-711f-4dcf-ad6e-90f0785f943f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:24.066940 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-63e4fce7-711f-4dcf-ad6e-90f0785f943f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:24.067759 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-63e4fce7-711f-4dcf-ad6e-90f0785f943f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:24.336815 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-69963910-f41e-45fb-843a-834248500351 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "POST /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1/action" status: 200 len: 32 microversion: 2.1 time: 0.535916 Jun 06 21:07:24.344199 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 147/303] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 6 21:07:23 2022] POST /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1/action => generated 32 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 21:07:24.388672 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b9220479-2d1c-4164-adb6-6dee99e9af60 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:24.389536 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-b9220479-2d1c-4164-adb6-6dee99e9af60 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:24.428573 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b9220479-2d1c-4164-adb6-6dee99e9af60 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:24.429378 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b9220479-2d1c-4164-adb6-6dee99e9af60 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:24.430208 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b9220479-2d1c-4164-adb6-6dee99e9af60 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:24.433410 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b9220479-2d1c-4164-adb6-6dee99e9af60 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:24.895945 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-63e4fce7-711f-4dcf-ad6e-90f0785f943f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:24.914994 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-63e4fce7-711f-4dcf-ad6e-90f0785f943f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:24.932177 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-63e4fce7-711f-4dcf-ad6e-90f0785f943f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:24.933620 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-63e4fce7-711f-4dcf-ad6e-90f0785f943f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1740 microversion: 2.20 time: 0.906203 Jun 06 21:07:24.944429 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 157/304] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:24 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1740 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:24.949163 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-873b031e-8835-4426-9ac8-5df071c23ae7 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:24.949795 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-873b031e-8835-4426-9ac8-5df071c23ae7 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:24.985123 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-873b031e-8835-4426-9ac8-5df071c23ae7 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:24.985571 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-873b031e-8835-4426-9ac8-5df071c23ae7 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:25.004346 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-873b031e-8835-4426-9ac8-5df071c23ae7 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:25.004817 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-873b031e-8835-4426-9ac8-5df071c23ae7 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:25.033346 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-b9220479-2d1c-4164-adb6-6dee99e9af60 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:25.054453 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-b9220479-2d1c-4164-adb6-6dee99e9af60 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.704925 Jun 06 21:07:25.065345 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 148/305] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:24 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:25.246693 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-ef8d74f4-0e4f-490b-9817-ecea3b85269d req-726c474a-b5c5-4779-aaea-dba9e495069a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a6a1d28-5f70-418f-8991-139855579e13", "tag": "20de69b0-9510-4128-a2cf-7b94f568ad57"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:07:25.275010 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-ef8d74f4-0e4f-490b-9817-ecea3b85269d req-726c474a-b5c5-4779-aaea-dba9e495069a service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:25.285967 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-ef8d74f4-0e4f-490b-9817-ecea3b85269d req-726c474a-b5c5-4779-aaea-dba9e495069a service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:25.297523 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:25.331921 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-ef8d74f4-0e4f-490b-9817-ecea3b85269d req-726c474a-b5c5-4779-aaea-dba9e495069a service nova] Creating event network-changed:20de69b0-9510-4128-a2cf-7b94f568ad57 for instance 8a6a1d28-5f70-418f-8991-139855579e13 on hv-cinder-84488 Jun 06 21:07:25.344237 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-ef8d74f4-0e4f-490b-9817-ecea3b85269d req-726c474a-b5c5-4779-aaea-dba9e495069a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102941 Jun 06 21:07:25.347843 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 149/306] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:07:25.954208 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-deac9fcc-29d0-484f-b321-4be97909ed1f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:25.956149 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-deac9fcc-29d0-484f-b321-4be97909ed1f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:25.973216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:25.979744 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-deac9fcc-29d0-484f-b321-4be97909ed1f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:25.981280 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-deac9fcc-29d0-484f-b321-4be97909ed1f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:25.983704 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-deac9fcc-29d0-484f-b321-4be97909ed1f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:25.990327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-deac9fcc-29d0-484f-b321-4be97909ed1f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:26.379419 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-873b031e-8835-4426-9ac8-5df071c23ae7 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:26.387738 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-deac9fcc-29d0-484f-b321-4be97909ed1f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:26.390293 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-873b031e-8835-4426-9ac8-5df071c23ae7 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1267 microversion: 2.1 time: 1.454631 Jun 06 21:07:26.394089 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 158/307] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:24 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1267 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:26.402004 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-deac9fcc-29d0-484f-b321-4be97909ed1f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:26.409467 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-deac9fcc-29d0-484f-b321-4be97909ed1f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:26.409809 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-92c08468-e6e9-4d66-ba0e-6590ea8f35ea tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:26.410544 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-92c08468-e6e9-4d66-ba0e-6590ea8f35ea tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:26.421217 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-deac9fcc-29d0-484f-b321-4be97909ed1f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1740 microversion: 2.20 time: 0.472023 Jun 06 21:07:26.422212 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 150/308] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:25 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1740 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:26.438405 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-92c08468-e6e9-4d66-ba0e-6590ea8f35ea tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:26.439152 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-92c08468-e6e9-4d66-ba0e-6590ea8f35ea tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:26.440178 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-92c08468-e6e9-4d66-ba0e-6590ea8f35ea tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:26.444323 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-92c08468-e6e9-4d66-ba0e-6590ea8f35ea tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:27.200274 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-92c08468-e6e9-4d66-ba0e-6590ea8f35ea tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:27.212133 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-92c08468-e6e9-4d66-ba0e-6590ea8f35ea tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.816182 Jun 06 21:07:27.233132 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 159/309] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:26 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:27.411655 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2eadcc07-dda2-46d4-88de-97205934df01 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:27.413699 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-2eadcc07-dda2-46d4-88de-97205934df01 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:27.448088 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-74558c9c-46fa-4781-a3f3-c5ad1901aaf9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:27.450231 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-74558c9c-46fa-4781-a3f3-c5ad1901aaf9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:27.459691 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2eadcc07-dda2-46d4-88de-97205934df01 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:27.460940 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2eadcc07-dda2-46d4-88de-97205934df01 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:27.463339 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2eadcc07-dda2-46d4-88de-97205934df01 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:27.467309 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2eadcc07-dda2-46d4-88de-97205934df01 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:27.487133 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-74558c9c-46fa-4781-a3f3-c5ad1901aaf9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:27.493159 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-74558c9c-46fa-4781-a3f3-c5ad1901aaf9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:27.501147 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-74558c9c-46fa-4781-a3f3-c5ad1901aaf9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:27.508155 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-74558c9c-46fa-4781-a3f3-c5ad1901aaf9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:28.045573 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2eadcc07-dda2-46d4-88de-97205934df01 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:28.059309 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-2eadcc07-dda2-46d4-88de-97205934df01 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1267 microversion: 2.1 time: 0.651425 Jun 06 21:07:28.062506 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 151/310] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:27 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1267 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:28.261271 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-d629781e-8566-4078-9eba-8808ee4540d9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:28.262051 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-d629781e-8566-4078-9eba-8808ee4540d9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:28.276248 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d629781e-8566-4078-9eba-8808ee4540d9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:28.276864 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d629781e-8566-4078-9eba-8808ee4540d9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:28.278445 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d629781e-8566-4078-9eba-8808ee4540d9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:28.279037 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d629781e-8566-4078-9eba-8808ee4540d9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:28.535832 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-74558c9c-46fa-4781-a3f3-c5ad1901aaf9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:28.623536 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-74558c9c-46fa-4781-a3f3-c5ad1901aaf9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:28.638002 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-74558c9c-46fa-4781-a3f3-c5ad1901aaf9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:28.640023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-74558c9c-46fa-4781-a3f3-c5ad1901aaf9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1740 microversion: 2.20 time: 1.199653 Jun 06 21:07:28.646690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 160/311] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:27 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1740 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:07:29.081713 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6cdb55ae-ceb6-47fd-bffe-c21e7e82a17f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:29.082690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6cdb55ae-ceb6-47fd-bffe-c21e7e82a17f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:29.095654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6cdb55ae-ceb6-47fd-bffe-c21e7e82a17f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:29.098732 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6cdb55ae-ceb6-47fd-bffe-c21e7e82a17f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:29.099809 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6cdb55ae-ceb6-47fd-bffe-c21e7e82a17f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:29.101058 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6cdb55ae-ceb6-47fd-bffe-c21e7e82a17f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:29.434631 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-d629781e-8566-4078-9eba-8808ee4540d9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:29.469386 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-d629781e-8566-4078-9eba-8808ee4540d9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 1.207173 Jun 06 21:07:29.504594 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 152/312] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:28 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:29.588309 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6cdb55ae-ceb6-47fd-bffe-c21e7e82a17f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:29.606493 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6cdb55ae-ceb6-47fd-bffe-c21e7e82a17f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1267 microversion: 2.1 time: 0.529163 Jun 06 21:07:29.607009 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 161/313] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:29 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1267 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:29.684119 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-9653844b-51f3-4b91-afbf-f8e0f9b222d1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:29.692254 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-9653844b-51f3-4b91-afbf-f8e0f9b222d1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:29.719091 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9653844b-51f3-4b91-afbf-f8e0f9b222d1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:29.723756 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9653844b-51f3-4b91-afbf-f8e0f9b222d1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:29.738495 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9653844b-51f3-4b91-afbf-f8e0f9b222d1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:29.739489 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9653844b-51f3-4b91-afbf-f8e0f9b222d1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:30.506153 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f3402fa6-1efc-4096-ab0a-b72f9aba36dc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:30.507565 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f3402fa6-1efc-4096-ab0a-b72f9aba36dc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:30.539109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f3402fa6-1efc-4096-ab0a-b72f9aba36dc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:30.540174 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f3402fa6-1efc-4096-ab0a-b72f9aba36dc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:30.546076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f3402fa6-1efc-4096-ab0a-b72f9aba36dc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:30.547257 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f3402fa6-1efc-4096-ab0a-b72f9aba36dc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:30.881384 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-9653844b-51f3-4b91-afbf-f8e0f9b222d1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:30.893816 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-9653844b-51f3-4b91-afbf-f8e0f9b222d1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:30.897672 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-9653844b-51f3-4b91-afbf-f8e0f9b222d1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:30.902225 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-9653844b-51f3-4b91-afbf-f8e0f9b222d1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1740 microversion: 2.20 time: 1.229544 Jun 06 21:07:30.928741 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 153/314] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:29 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1740 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:30.947429 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0c59678d-6447-48d4-b25f-e7debcef1090 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:30.948891 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-0c59678d-6447-48d4-b25f-e7debcef1090 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:30.986275 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0c59678d-6447-48d4-b25f-e7debcef1090 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:30.987639 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0c59678d-6447-48d4-b25f-e7debcef1090 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:30.993527 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0c59678d-6447-48d4-b25f-e7debcef1090 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:30.995016 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0c59678d-6447-48d4-b25f-e7debcef1090 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:31.007554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f3402fa6-1efc-4096-ab0a-b72f9aba36dc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:31.044942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f3402fa6-1efc-4096-ab0a-b72f9aba36dc tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.547271 Jun 06 21:07:31.061327 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 162/315] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:30 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:07:31.423227 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-0c59678d-6447-48d4-b25f-e7debcef1090 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:31.441554 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-0c59678d-6447-48d4-b25f-e7debcef1090 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1267 microversion: 2.1 time: 0.511291 Jun 06 21:07:31.444877 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 154/316] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:30 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1267 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:31.934517 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-38f5e299-2049-4d90-ac62-c3ff9a546cc7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:31.935510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-38f5e299-2049-4d90-ac62-c3ff9a546cc7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:31.947853 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-38f5e299-2049-4d90-ac62-c3ff9a546cc7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:31.950482 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-38f5e299-2049-4d90-ac62-c3ff9a546cc7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:31.954355 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-38f5e299-2049-4d90-ac62-c3ff9a546cc7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:31.955172 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-38f5e299-2049-4d90-ac62-c3ff9a546cc7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:32.075122 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-a98364d6-3a34-4cca-9188-4206ae130dbd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:32.082265 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-a98364d6-3a34-4cca-9188-4206ae130dbd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:32.109075 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a98364d6-3a34-4cca-9188-4206ae130dbd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:32.110225 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a98364d6-3a34-4cca-9188-4206ae130dbd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:32.113703 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a98364d6-3a34-4cca-9188-4206ae130dbd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:32.114892 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a98364d6-3a34-4cca-9188-4206ae130dbd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:32.483331 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-38f5e299-2049-4d90-ac62-c3ff9a546cc7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:32.495178 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-38f5e299-2049-4d90-ac62-c3ff9a546cc7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:32.502043 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-38f5e299-2049-4d90-ac62-c3ff9a546cc7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:32.503552 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-38f5e299-2049-4d90-ac62-c3ff9a546cc7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1740 microversion: 2.20 time: 0.573355 Jun 06 21:07:32.506426 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 163/317] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:31 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1740 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:07:32.517919 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8cf4bc4c-70dc-47bf-b631-e889366bcda0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:32.525003 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8cf4bc4c-70dc-47bf-b631-e889366bcda0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:32.536976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8cf4bc4c-70dc-47bf-b631-e889366bcda0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:32.537715 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8cf4bc4c-70dc-47bf-b631-e889366bcda0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:32.540434 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8cf4bc4c-70dc-47bf-b631-e889366bcda0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:32.543203 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8cf4bc4c-70dc-47bf-b631-e889366bcda0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:32.801404 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8cf4bc4c-70dc-47bf-b631-e889366bcda0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:32.811974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8cf4bc4c-70dc-47bf-b631-e889366bcda0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1267 microversion: 2.1 time: 0.301429 Jun 06 21:07:32.813584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 164/318] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:32 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1267 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:33.001806 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-a98364d6-3a34-4cca-9188-4206ae130dbd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:33.019179 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-a98364d6-3a34-4cca-9188-4206ae130dbd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.951597 Jun 06 21:07:33.019961 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 155/319] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:32 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:07:33.526725 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-eedaf7ed-7f09-458d-b6a5-941d15c4bb21 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:33.527347 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-eedaf7ed-7f09-458d-b6a5-941d15c4bb21 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:33.551386 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eedaf7ed-7f09-458d-b6a5-941d15c4bb21 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:33.568942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eedaf7ed-7f09-458d-b6a5-941d15c4bb21 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:33.578794 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eedaf7ed-7f09-458d-b6a5-941d15c4bb21 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:33.579260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eedaf7ed-7f09-458d-b6a5-941d15c4bb21 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:33.668125 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:33.831190 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-95c2916e-4b4b-4599-8a44-15ae48d66a49 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:33.831846 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-95c2916e-4b4b-4599-8a44-15ae48d66a49 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:33.862451 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-95c2916e-4b4b-4599-8a44-15ae48d66a49 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:33.867443 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-95c2916e-4b4b-4599-8a44-15ae48d66a49 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:33.869143 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-95c2916e-4b4b-4599-8a44-15ae48d66a49 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:33.869786 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-95c2916e-4b4b-4599-8a44-15ae48d66a49 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:34.202554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-eedaf7ed-7f09-458d-b6a5-941d15c4bb21 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:34.220167 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-eedaf7ed-7f09-458d-b6a5-941d15c4bb21 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:34.221767 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-eedaf7ed-7f09-458d-b6a5-941d15c4bb21 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:34.223189 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-eedaf7ed-7f09-458d-b6a5-941d15c4bb21 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1740 microversion: 2.20 time: 0.703167 Jun 06 21:07:34.238871 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-95c2916e-4b4b-4599-8a44-15ae48d66a49 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:34.259327 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 165/320] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:33 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1740 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:34.262187 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-95c2916e-4b4b-4599-8a44-15ae48d66a49 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1267 microversion: 2.1 time: 0.435696 Jun 06 21:07:34.266102 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-980f651a-045b-4741-bbbd-7ccba241db21 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:34.267106 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 156/321] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:33 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1267 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:34.268010 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-980f651a-045b-4741-bbbd-7ccba241db21 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:34.277780 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-980f651a-045b-4741-bbbd-7ccba241db21 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:34.278241 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-980f651a-045b-4741-bbbd-7ccba241db21 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:34.279057 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-980f651a-045b-4741-bbbd-7ccba241db21 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:34.279489 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-980f651a-045b-4741-bbbd-7ccba241db21 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:34.566756 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-980f651a-045b-4741-bbbd-7ccba241db21 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:34.579585 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-980f651a-045b-4741-bbbd-7ccba241db21 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.318876 Jun 06 21:07:34.593814 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 166/322] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:34 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:35.262895 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-7ac6c5c5-f475-4508-b08d-339b72117e95 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:35.264328 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-7ac6c5c5-f475-4508-b08d-339b72117e95 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:35.282692 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-712a30c4-0754-4161-be56-3b461cd1f8a0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:35.283623 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-712a30c4-0754-4161-be56-3b461cd1f8a0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:35.293017 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7ac6c5c5-f475-4508-b08d-339b72117e95 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:35.300247 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-712a30c4-0754-4161-be56-3b461cd1f8a0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:35.300918 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-712a30c4-0754-4161-be56-3b461cd1f8a0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:35.301726 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7ac6c5c5-f475-4508-b08d-339b72117e95 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:35.302702 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-712a30c4-0754-4161-be56-3b461cd1f8a0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:35.303706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7ac6c5c5-f475-4508-b08d-339b72117e95 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:35.306326 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-712a30c4-0754-4161-be56-3b461cd1f8a0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:35.312800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7ac6c5c5-f475-4508-b08d-339b72117e95 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:35.630803 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-7ac6c5c5-f475-4508-b08d-339b72117e95 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:35.640118 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-7ac6c5c5-f475-4508-b08d-339b72117e95 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:35.649892 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-7ac6c5c5-f475-4508-b08d-339b72117e95 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:35.651572 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-7ac6c5c5-f475-4508-b08d-339b72117e95 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1740 microversion: 2.20 time: 0.392654 Jun 06 21:07:35.656625 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 157/323] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:35 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1740 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:35.662377 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-3098ef99-a4b1-4bf9-bdb1-61479ea1ec6d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:35.666718 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-3098ef99-a4b1-4bf9-bdb1-61479ea1ec6d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:35.679800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3098ef99-a4b1-4bf9-bdb1-61479ea1ec6d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:35.682590 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3098ef99-a4b1-4bf9-bdb1-61479ea1ec6d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:35.683785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3098ef99-a4b1-4bf9-bdb1-61479ea1ec6d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:35.685514 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3098ef99-a4b1-4bf9-bdb1-61479ea1ec6d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:36.021279 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-3098ef99-a4b1-4bf9-bdb1-61479ea1ec6d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:36.030208 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-3098ef99-a4b1-4bf9-bdb1-61479ea1ec6d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.371854 Jun 06 21:07:36.058729 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 158/324] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:35 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:36.483146 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-ac9c0de6-5368-45a0-b24c-c08671867b8e req-80f5560d-df3e-4d62-900a-06c5bce4962b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56edbb7a-b8fb-4934-a7f5-9f2cf82542a3", "name": "network-vif-plugged", "status": "completed", "tag": "0e363b5d-cbf1-4fca-be7e-728a1e94a07d"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:07:36.542379 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-ac9c0de6-5368-45a0-b24c-c08671867b8e req-80f5560d-df3e-4d62-900a-06c5bce4962b service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:36.545328 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-ac9c0de6-5368-45a0-b24c-c08671867b8e req-80f5560d-df3e-4d62-900a-06c5bce4962b service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:36.671060 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-ac9c0de6-5368-45a0-b24c-c08671867b8e req-80f5560d-df3e-4d62-900a-06c5bce4962b service nova] Creating event network-vif-plugged:0e363b5d-cbf1-4fca-be7e-728a1e94a07d for instance 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 on hv-cinder-84488 Jun 06 21:07:36.687487 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-ac9c0de6-5368-45a0-b24c-c08671867b8e req-80f5560d-df3e-4d62-900a-06c5bce4962b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213868 Jun 06 21:07:36.688015 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 159/325] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:07:36.738627 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-d052ab24-0858-4e7f-94b9-bf05b71ae2b2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:36.738627 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-d052ab24-0858-4e7f-94b9-bf05b71ae2b2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:36.754915 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d052ab24-0858-4e7f-94b9-bf05b71ae2b2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:36.755444 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d052ab24-0858-4e7f-94b9-bf05b71ae2b2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:36.757347 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d052ab24-0858-4e7f-94b9-bf05b71ae2b2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:36.757697 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d052ab24-0858-4e7f-94b9-bf05b71ae2b2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:36.956706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-712a30c4-0754-4161-be56-3b461cd1f8a0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:36.965370 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-712a30c4-0754-4161-be56-3b461cd1f8a0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1267 microversion: 2.1 time: 1.686330 Jun 06 21:07:36.973450 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 167/326] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:35 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1267 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:07:37.069553 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0ac46141-a4cb-46d7-bb2f-7ecc1f70d5b7 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:37.070164 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0ac46141-a4cb-46d7-bb2f-7ecc1f70d5b7 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:37.088601 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0ac46141-a4cb-46d7-bb2f-7ecc1f70d5b7 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:37.089079 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0ac46141-a4cb-46d7-bb2f-7ecc1f70d5b7 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:37.089904 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0ac46141-a4cb-46d7-bb2f-7ecc1f70d5b7 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:37.094234 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0ac46141-a4cb-46d7-bb2f-7ecc1f70d5b7 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:37.286984 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-d052ab24-0858-4e7f-94b9-bf05b71ae2b2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:37.318595 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-d052ab24-0858-4e7f-94b9-bf05b71ae2b2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:37.323984 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-d052ab24-0858-4e7f-94b9-bf05b71ae2b2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:37.336464 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-d052ab24-0858-4e7f-94b9-bf05b71ae2b2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1740 microversion: 2.20 time: 0.608803 Jun 06 21:07:37.337798 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 160/327] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:36 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1740 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:37.585255 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0ac46141-a4cb-46d7-bb2f-7ecc1f70d5b7 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:37.600161 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0ac46141-a4cb-46d7-bb2f-7ecc1f70d5b7 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.534373 Jun 06 21:07:37.608430 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 168/328] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:37 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:37.983698 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0b8caf7b-ed9f-407d-99fa-96a488037265 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:37.984617 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-0b8caf7b-ed9f-407d-99fa-96a488037265 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:38.001099 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0b8caf7b-ed9f-407d-99fa-96a488037265 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:38.001838 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0b8caf7b-ed9f-407d-99fa-96a488037265 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:38.003119 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0b8caf7b-ed9f-407d-99fa-96a488037265 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:38.003843 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0b8caf7b-ed9f-407d-99fa-96a488037265 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:38.335231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-0b8caf7b-ed9f-407d-99fa-96a488037265 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:38.348662 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-0b8caf7b-ed9f-407d-99fa-96a488037265 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1267 microversion: 2.1 time: 0.368933 Jun 06 21:07:38.350032 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 161/329] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:37 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1267 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:07:38.355783 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-23638f21-6c0f-4636-b8cd-153b84de8f7b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:38.360497 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-23638f21-6c0f-4636-b8cd-153b84de8f7b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:38.371586 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-23638f21-6c0f-4636-b8cd-153b84de8f7b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:38.381131 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-23638f21-6c0f-4636-b8cd-153b84de8f7b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:38.382887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-23638f21-6c0f-4636-b8cd-153b84de8f7b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:38.385536 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-23638f21-6c0f-4636-b8cd-153b84de8f7b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:38.622297 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-ce95f197-3540-4bf9-950f-535327314b24 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:38.624309 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-ce95f197-3540-4bf9-950f-535327314b24 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:38.651408 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ce95f197-3540-4bf9-950f-535327314b24 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:38.663704 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ce95f197-3540-4bf9-950f-535327314b24 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:38.664910 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ce95f197-3540-4bf9-950f-535327314b24 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:38.665691 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ce95f197-3540-4bf9-950f-535327314b24 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:39.169753 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-ce95f197-3540-4bf9-950f-535327314b24 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:39.184853 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-ce95f197-3540-4bf9-950f-535327314b24 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.569639 Jun 06 21:07:39.190236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 162/330] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:38 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:07:39.384910 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-23638f21-6c0f-4636-b8cd-153b84de8f7b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:39.390403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-6bdf8c6f-d3f5-4f31-9213-3c9943402558 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:39.393888 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-6bdf8c6f-d3f5-4f31-9213-3c9943402558 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:39.415951 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-23638f21-6c0f-4636-b8cd-153b84de8f7b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:39.419066 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6bdf8c6f-d3f5-4f31-9213-3c9943402558 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:39.419838 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6bdf8c6f-d3f5-4f31-9213-3c9943402558 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:39.422326 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6bdf8c6f-d3f5-4f31-9213-3c9943402558 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:39.424564 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6bdf8c6f-d3f5-4f31-9213-3c9943402558 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:39.428239 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-23638f21-6c0f-4636-b8cd-153b84de8f7b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:39.430826 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-23638f21-6c0f-4636-b8cd-153b84de8f7b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1740 microversion: 2.20 time: 1.078978 Jun 06 21:07:39.433658 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 169/331] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:38 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1740 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:07:39.783384 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-6bdf8c6f-d3f5-4f31-9213-3c9943402558 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:39.801834 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-6bdf8c6f-d3f5-4f31-9213-3c9943402558 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1453 microversion: 2.1 time: 0.429523 Jun 06 21:07:39.802355 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 163/332] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:39 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1453 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:39.833865 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d8598060-8cf3-4f04-8834-51bdb2dbb9d1 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:39.834769 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d8598060-8cf3-4f04-8834-51bdb2dbb9d1 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:39.846237 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=64 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:39.854495 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8598060-8cf3-4f04-8834-51bdb2dbb9d1 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:39.855297 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8598060-8cf3-4f04-8834-51bdb2dbb9d1 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:39.856490 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8598060-8cf3-4f04-8834-51bdb2dbb9d1 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:39.857136 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8598060-8cf3-4f04-8834-51bdb2dbb9d1 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:40.218633 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-f182a3b5-0f06-446a-88e9-a0baeaec35bd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:40.219189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-f182a3b5-0f06-446a-88e9-a0baeaec35bd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:40.232894 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f182a3b5-0f06-446a-88e9-a0baeaec35bd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:40.233529 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f182a3b5-0f06-446a-88e9-a0baeaec35bd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:40.234521 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f182a3b5-0f06-446a-88e9-a0baeaec35bd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:40.235057 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f182a3b5-0f06-446a-88e9-a0baeaec35bd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:40.319108 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d8598060-8cf3-4f04-8834-51bdb2dbb9d1 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:40.335476 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d8598060-8cf3-4f04-8834-51bdb2dbb9d1 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1453 microversion: 2.1 time: 0.506170 Jun 06 21:07:40.338664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 170/333] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:39 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1453 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:40.469680 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5054402e-b5a5-4702-a1ad-efad275e702f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:40.470397 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5054402e-b5a5-4702-a1ad-efad275e702f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:40.478971 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-f182a3b5-0f06-446a-88e9-a0baeaec35bd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:40.482152 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5054402e-b5a5-4702-a1ad-efad275e702f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:40.488768 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5054402e-b5a5-4702-a1ad-efad275e702f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:40.491420 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5054402e-b5a5-4702-a1ad-efad275e702f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:40.492807 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-f182a3b5-0f06-446a-88e9-a0baeaec35bd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.281470 Jun 06 21:07:40.495417 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 164/334] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:40 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:40.496353 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5054402e-b5a5-4702-a1ad-efad275e702f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:40.875673 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5054402e-b5a5-4702-a1ad-efad275e702f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:40.925288 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5054402e-b5a5-4702-a1ad-efad275e702f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:40.929393 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5054402e-b5a5-4702-a1ad-efad275e702f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:40.940132 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5054402e-b5a5-4702-a1ad-efad275e702f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1722 microversion: 2.20 time: 0.475042 Jun 06 21:07:40.947916 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 171/335] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:40 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1722 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:41.190930 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-3d35998a-cab3-4429-88a5-4099af4b3327 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Action: 'create', calling method: .version_select at 0x7f27261098b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-408149276", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoA2oI6XEQGCSr5t7+6ql9YEDFYUS9eOSfoFbAMxBPWWbpCajdoqWaE9K3HOt2rCEguhgqYgOgz1By3YdZp2FrDXWi77xWw4svTT/fP1Uz1Px/ucB+MYArmPcBRMDw3ZA=="}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:07:41.235647 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-3d35998a-cab3-4429-88a5-4099af4b3327 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Getting quotas for project 5a68679e2b3544bbb82f944fcae970ef. Resources: {'key_pairs'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:07:41.246725 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-3d35998a-cab3-4429-88a5-4099af4b3327 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Getting quotas for user 36e865c93d844d8aa23661f779cd8e60 and project 5a68679e2b3544bbb82f944fcae970ef. Resources: {'key_pairs'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:07:41.319832 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-3d35998a-cab3-4429-88a5-4099af4b3327 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.784261 Jun 06 21:07:41.321285 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 165/336] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jun 6 21:07:40 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:07:41.514970 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-901aae1a-6704-4ebf-8324-b86b1c2878e3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:41.521476 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-901aae1a-6704-4ebf-8324-b86b1c2878e3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:41.534812 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-901aae1a-6704-4ebf-8324-b86b1c2878e3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:41.535726 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-901aae1a-6704-4ebf-8324-b86b1c2878e3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:41.537583 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-901aae1a-6704-4ebf-8324-b86b1c2878e3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:41.539041 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-901aae1a-6704-4ebf-8324-b86b1c2878e3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:41.727537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-901aae1a-6704-4ebf-8324-b86b1c2878e3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:41.738430 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-901aae1a-6704-4ebf-8324-b86b1c2878e3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.227444 Jun 06 21:07:41.739514 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 172/337] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:41 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:41.976224 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-1f20964d-987e-4d9b-bc2a-a8455dc4ee55 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:41.978128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-1f20964d-987e-4d9b-bc2a-a8455dc4ee55 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:41.992445 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1f20964d-987e-4d9b-bc2a-a8455dc4ee55 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:41.996747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1f20964d-987e-4d9b-bc2a-a8455dc4ee55 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:41.999248 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1f20964d-987e-4d9b-bc2a-a8455dc4ee55 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:42.002677 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1f20964d-987e-4d9b-bc2a-a8455dc4ee55 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:42.411116 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-1f20964d-987e-4d9b-bc2a-a8455dc4ee55 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:42.423718 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-1f20964d-987e-4d9b-bc2a-a8455dc4ee55 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:42.426941 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-1f20964d-987e-4d9b-bc2a-a8455dc4ee55 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:42.428540 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-1f20964d-987e-4d9b-bc2a-a8455dc4ee55 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1722 microversion: 2.20 time: 0.456439 Jun 06 21:07:42.429703 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 166/338] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:41 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1722 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:42.765018 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-05a13c67-300a-422b-8730-e235b875689d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:42.765804 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-05a13c67-300a-422b-8730-e235b875689d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:42.782192 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-05a13c67-300a-422b-8730-e235b875689d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:42.782861 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-05a13c67-300a-422b-8730-e235b875689d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:42.787959 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-05a13c67-300a-422b-8730-e235b875689d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:42.788636 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-05a13c67-300a-422b-8730-e235b875689d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:42.949852 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-05a13c67-300a-422b-8730-e235b875689d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:42.959601 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-05a13c67-300a-422b-8730-e235b875689d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.205408 Jun 06 21:07:42.960853 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 173/339] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:42 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:43.446928 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-7d0262dd-72af-40dd-90e0-d3cca925b468 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:43.447589 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-7d0262dd-72af-40dd-90e0-d3cca925b468 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:43.456532 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7d0262dd-72af-40dd-90e0-d3cca925b468 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:43.456970 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7d0262dd-72af-40dd-90e0-d3cca925b468 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:43.457955 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7d0262dd-72af-40dd-90e0-d3cca925b468 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:43.458568 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7d0262dd-72af-40dd-90e0-d3cca925b468 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:43.813362 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-7d0262dd-72af-40dd-90e0-d3cca925b468 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:43.838502 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-7d0262dd-72af-40dd-90e0-d3cca925b468 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:43.840964 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-7d0262dd-72af-40dd-90e0-d3cca925b468 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:43.842526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-7d0262dd-72af-40dd-90e0-d3cca925b468 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1722 microversion: 2.20 time: 0.399631 Jun 06 21:07:43.844479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 167/340] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:43 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1722 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:43.977565 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-94cc47b8-62c7-41c0-b6ff-eeddd512ceeb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:43.978386 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-94cc47b8-62c7-41c0-b6ff-eeddd512ceeb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:43.995176 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-94cc47b8-62c7-41c0-b6ff-eeddd512ceeb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:43.997337 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-94cc47b8-62c7-41c0-b6ff-eeddd512ceeb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:43.998661 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-94cc47b8-62c7-41c0-b6ff-eeddd512ceeb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:43.999495 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-94cc47b8-62c7-41c0-b6ff-eeddd512ceeb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:44.246966 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-c97bbcc0-fca5-461f-a6c9-d15b8c047183 req-232b013e-d63f-4b7f-8076-cba22e144b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1886e3bf-c735-4f91-8a2f-0bc6996982e0", "name": "network-vif-unplugged", "status": "completed", "tag": "2e4dc91b-9fa1-4ca1-9827-0ca3ef02a18e"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:07:44.266304 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-c97bbcc0-fca5-461f-a6c9-d15b8c047183 req-232b013e-d63f-4b7f-8076-cba22e144b43 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:44.266657 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-c97bbcc0-fca5-461f-a6c9-d15b8c047183 req-232b013e-d63f-4b7f-8076-cba22e144b43 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:44.279984 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=100 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:44.294678 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-c97bbcc0-fca5-461f-a6c9-d15b8c047183 req-232b013e-d63f-4b7f-8076-cba22e144b43 service nova] Creating event network-vif-unplugged:2e4dc91b-9fa1-4ca1-9827-0ca3ef02a18e for instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 on hv-cinder-84488 Jun 06 21:07:44.301253 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-c97bbcc0-fca5-461f-a6c9-d15b8c047183 req-232b013e-d63f-4b7f-8076-cba22e144b43 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065522 Jun 06 21:07:44.302575 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 168/341] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:07:44.387111 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-94cc47b8-62c7-41c0-b6ff-eeddd512ceeb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:44.396407 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-94cc47b8-62c7-41c0-b6ff-eeddd512ceeb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.423149 Jun 06 21:07:44.401240 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 174/342] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:43 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:44.642792 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-d16338a8-439a-409c-a114-68e3d43b8ff2 req-07b1a66e-ab14-4463-905e-51cd27d095bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56edbb7a-b8fb-4934-a7f5-9f2cf82542a3", "tag": "0e363b5d-cbf1-4fca-be7e-728a1e94a07d"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:07:44.655704 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-d16338a8-439a-409c-a114-68e3d43b8ff2 req-07b1a66e-ab14-4463-905e-51cd27d095bb service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:44.656313 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-d16338a8-439a-409c-a114-68e3d43b8ff2 req-07b1a66e-ab14-4463-905e-51cd27d095bb service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:44.677693 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-d16338a8-439a-409c-a114-68e3d43b8ff2 req-07b1a66e-ab14-4463-905e-51cd27d095bb service nova] Creating event network-changed:0e363b5d-cbf1-4fca-be7e-728a1e94a07d for instance 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 on hv-cinder-84488 Jun 06 21:07:44.685238 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-d16338a8-439a-409c-a114-68e3d43b8ff2 req-07b1a66e-ab14-4463-905e-51cd27d095bb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047883 Jun 06 21:07:44.690746 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 169/343] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:07:44.864191 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9ab984ee-b08d-4494-b7f5-dc4a766f8876 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:44.864894 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9ab984ee-b08d-4494-b7f5-dc4a766f8876 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:44.885448 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9ab984ee-b08d-4494-b7f5-dc4a766f8876 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:44.886138 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9ab984ee-b08d-4494-b7f5-dc4a766f8876 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:44.887118 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9ab984ee-b08d-4494-b7f5-dc4a766f8876 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:44.895066 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9ab984ee-b08d-4494-b7f5-dc4a766f8876 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:45.290527 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9ab984ee-b08d-4494-b7f5-dc4a766f8876 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:45.306153 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9ab984ee-b08d-4494-b7f5-dc4a766f8876 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:45.308756 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9ab984ee-b08d-4494-b7f5-dc4a766f8876 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:45.310526 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9ab984ee-b08d-4494-b7f5-dc4a766f8876 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1725 microversion: 2.20 time: 0.452371 Jun 06 21:07:45.311804 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 175/344] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:44 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1725 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:45.330434 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-677ef888-7d8e-4f55-abcb-08c253ba7975 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac26a947-f2f0-4e65-bc4a-6831ee497c1a"}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:07:45.331844 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-677ef888-7d8e-4f55-abcb-08c253ba7975 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:45.339439 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-677ef888-7d8e-4f55-abcb-08c253ba7975 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:45.342442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-677ef888-7d8e-4f55-abcb-08c253ba7975 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:45.345627 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-677ef888-7d8e-4f55-abcb-08c253ba7975 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:45.346289 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-677ef888-7d8e-4f55-abcb-08c253ba7975 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:45.416996 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a0ec3e9c-f690-4e2e-abf8-323bde0f325d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:45.417815 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a0ec3e9c-f690-4e2e-abf8-323bde0f325d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:45.429914 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a0ec3e9c-f690-4e2e-abf8-323bde0f325d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:45.433421 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a0ec3e9c-f690-4e2e-abf8-323bde0f325d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:45.436059 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a0ec3e9c-f690-4e2e-abf8-323bde0f325d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:45.436833 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a0ec3e9c-f690-4e2e-abf8-323bde0f325d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:45.668563 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a0ec3e9c-f690-4e2e-abf8-323bde0f325d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:45.680818 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a0ec3e9c-f690-4e2e-abf8-323bde0f325d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.270361 Jun 06 21:07:45.682520 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 176/345] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:45 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:07:45.789625 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-677ef888-7d8e-4f55-abcb-08c253ba7975 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "POST /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.463745 Jun 06 21:07:45.791907 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 170/346] 10.222.0.33 () {62 vars in 1363 bytes} [Mon Jun 6 21:07:45 2022] POST /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0/os-volume_attachments => generated 188 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 21:07:45.954113 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ab7a7e31-787f-49c5-a0b1-529f3226aa43 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:07:45.955393 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ab7a7e31-787f-49c5-a0b1-529f3226aa43 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:45.963134 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ab7a7e31-787f-49c5-a0b1-529f3226aa43 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:45.963134 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ab7a7e31-787f-49c5-a0b1-529f3226aa43 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:45.964339 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ab7a7e31-787f-49c5-a0b1-529f3226aa43 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:45.964957 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ab7a7e31-787f-49c5-a0b1-529f3226aa43 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:46.080280 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ab7a7e31-787f-49c5-a0b1-529f3226aa43 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "POST /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0/action" status: 202 len: 0 microversion: 2.20 time: 0.135112 Jun 06 21:07:46.081089 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 177/347] 10.222.0.33 () {62 vars in 1318 bytes} [Mon Jun 6 21:07:45 2022] POST /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 21:07:46.091744 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e9e4c3b0-a4c0-4a6b-aa14-8c0428b6ee62 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:46.092781 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-e9e4c3b0-a4c0-4a6b-aa14-8c0428b6ee62 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:46.116878 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e9e4c3b0-a4c0-4a6b-aa14-8c0428b6ee62 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:46.117536 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e9e4c3b0-a4c0-4a6b-aa14-8c0428b6ee62 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:46.118785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e9e4c3b0-a4c0-4a6b-aa14-8c0428b6ee62 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:46.120384 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e9e4c3b0-a4c0-4a6b-aa14-8c0428b6ee62 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:46.348761 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e9e4c3b0-a4c0-4a6b-aa14-8c0428b6ee62 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:46.372934 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e9e4c3b0-a4c0-4a6b-aa14-8c0428b6ee62 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:46.375717 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e9e4c3b0-a4c0-4a6b-aa14-8c0428b6ee62 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:46.380478 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-e9e4c3b0-a4c0-4a6b-aa14-8c0428b6ee62 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1751 microversion: 2.20 time: 0.294335 Jun 06 21:07:46.382031 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 171/348] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:46 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1751 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:07:46.700208 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b564bbcf-3a2d-4515-89f7-9345c27b3bac tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:46.701770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b564bbcf-3a2d-4515-89f7-9345c27b3bac tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:46.711778 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b564bbcf-3a2d-4515-89f7-9345c27b3bac tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:46.712471 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b564bbcf-3a2d-4515-89f7-9345c27b3bac tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:46.716857 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b564bbcf-3a2d-4515-89f7-9345c27b3bac tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:46.720677 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b564bbcf-3a2d-4515-89f7-9345c27b3bac tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:46.963554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b564bbcf-3a2d-4515-89f7-9345c27b3bac tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:46.972348 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b564bbcf-3a2d-4515-89f7-9345c27b3bac tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.277163 Jun 06 21:07:46.973249 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 178/349] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:46 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:47.405751 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-a26c21fa-7ae9-4e7f-9061-7cf32b034fd2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:47.407244 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-a26c21fa-7ae9-4e7f-9061-7cf32b034fd2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:47.414215 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a26c21fa-7ae9-4e7f-9061-7cf32b034fd2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:47.414662 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a26c21fa-7ae9-4e7f-9061-7cf32b034fd2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:47.415550 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a26c21fa-7ae9-4e7f-9061-7cf32b034fd2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:47.415974 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a26c21fa-7ae9-4e7f-9061-7cf32b034fd2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:47.605908 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-a26c21fa-7ae9-4e7f-9061-7cf32b034fd2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:47.615663 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-a26c21fa-7ae9-4e7f-9061-7cf32b034fd2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:47.617639 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-a26c21fa-7ae9-4e7f-9061-7cf32b034fd2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:47.618964 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-a26c21fa-7ae9-4e7f-9061-7cf32b034fd2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1751 microversion: 2.20 time: 0.217670 Jun 06 21:07:47.619532 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 172/350] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:47 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1751 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:47.989968 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-749c8b87-e5f1-468c-bc4f-ecf2c11383ea tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:47.990623 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-749c8b87-e5f1-468c-bc4f-ecf2c11383ea tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:47.997729 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-749c8b87-e5f1-468c-bc4f-ecf2c11383ea tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:47.998255 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-749c8b87-e5f1-468c-bc4f-ecf2c11383ea tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:47.999112 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-749c8b87-e5f1-468c-bc4f-ecf2c11383ea tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:47.999662 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-749c8b87-e5f1-468c-bc4f-ecf2c11383ea tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:48.171881 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-749c8b87-e5f1-468c-bc4f-ecf2c11383ea tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:48.188690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-749c8b87-e5f1-468c-bc4f-ecf2c11383ea tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.202478 Jun 06 21:07:48.189288 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 179/351] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:47 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:48.637808 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-7378adbc-8d43-4b9a-bb6d-5716103836cd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:48.638519 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-7378adbc-8d43-4b9a-bb6d-5716103836cd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:48.645267 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7378adbc-8d43-4b9a-bb6d-5716103836cd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:48.645681 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7378adbc-8d43-4b9a-bb6d-5716103836cd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:48.646456 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7378adbc-8d43-4b9a-bb6d-5716103836cd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:48.646853 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7378adbc-8d43-4b9a-bb6d-5716103836cd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:48.798044 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-7378adbc-8d43-4b9a-bb6d-5716103836cd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:48.808341 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-7378adbc-8d43-4b9a-bb6d-5716103836cd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:48.809856 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-7378adbc-8d43-4b9a-bb6d-5716103836cd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:48.811243 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-7378adbc-8d43-4b9a-bb6d-5716103836cd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1753 microversion: 2.20 time: 0.177399 Jun 06 21:07:48.811604 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 173/352] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:48 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:49.207096 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-36635ce0-45a8-4fe9-989f-2fd731623590 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:49.207642 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-36635ce0-45a8-4fe9-989f-2fd731623590 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:49.215911 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-36635ce0-45a8-4fe9-989f-2fd731623590 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:49.216376 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-36635ce0-45a8-4fe9-989f-2fd731623590 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:49.217131 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-36635ce0-45a8-4fe9-989f-2fd731623590 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:49.217552 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-36635ce0-45a8-4fe9-989f-2fd731623590 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:49.359436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-36635ce0-45a8-4fe9-989f-2fd731623590 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:49.370461 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-36635ce0-45a8-4fe9-989f-2fd731623590 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.168615 Jun 06 21:07:49.371011 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 180/353] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:49 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:49.830599 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-da64c17c-f6df-4be8-b8af-e4877c12f703 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:49.831203 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-da64c17c-f6df-4be8-b8af-e4877c12f703 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:49.838095 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-da64c17c-f6df-4be8-b8af-e4877c12f703 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:49.838572 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-da64c17c-f6df-4be8-b8af-e4877c12f703 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:49.839415 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-da64c17c-f6df-4be8-b8af-e4877c12f703 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:49.839886 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-da64c17c-f6df-4be8-b8af-e4877c12f703 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:49.986474 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-da64c17c-f6df-4be8-b8af-e4877c12f703 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:49.997645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-da64c17c-f6df-4be8-b8af-e4877c12f703 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:50.000065 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-da64c17c-f6df-4be8-b8af-e4877c12f703 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:50.002189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-da64c17c-f6df-4be8-b8af-e4877c12f703 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1753 microversion: 2.20 time: 0.175804 Jun 06 21:07:50.003022 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 174/354] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:49 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:50.389885 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9aeeb47b-c430-46cf-85e9-2c5cb4d61bb9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:50.390503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9aeeb47b-c430-46cf-85e9-2c5cb4d61bb9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:50.398483 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9aeeb47b-c430-46cf-85e9-2c5cb4d61bb9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:50.398899 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9aeeb47b-c430-46cf-85e9-2c5cb4d61bb9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:50.399663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9aeeb47b-c430-46cf-85e9-2c5cb4d61bb9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:50.400146 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9aeeb47b-c430-46cf-85e9-2c5cb4d61bb9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:50.403384 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:50.557399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9aeeb47b-c430-46cf-85e9-2c5cb4d61bb9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:50.567187 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9aeeb47b-c430-46cf-85e9-2c5cb4d61bb9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.181430 Jun 06 21:07:50.568129 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 181/355] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:50 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:51.021357 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-704754ff-ea0e-49bf-8b54-66c43d2c2fec tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:51.021888 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-704754ff-ea0e-49bf-8b54-66c43d2c2fec tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:51.029389 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-704754ff-ea0e-49bf-8b54-66c43d2c2fec tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:51.029835 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-704754ff-ea0e-49bf-8b54-66c43d2c2fec tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:51.030601 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-704754ff-ea0e-49bf-8b54-66c43d2c2fec tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:51.031059 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-704754ff-ea0e-49bf-8b54-66c43d2c2fec tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:51.180209 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-704754ff-ea0e-49bf-8b54-66c43d2c2fec tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:51.189765 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-704754ff-ea0e-49bf-8b54-66c43d2c2fec tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:51.191397 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-704754ff-ea0e-49bf-8b54-66c43d2c2fec tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:51.192608 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-704754ff-ea0e-49bf-8b54-66c43d2c2fec tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1753 microversion: 2.20 time: 0.175344 Jun 06 21:07:51.193163 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 175/356] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:51 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:51.585809 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-52b4f45c-c5cb-4888-b03c-c1bea313c3a9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:51.585809 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-52b4f45c-c5cb-4888-b03c-c1bea313c3a9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:51.594026 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-52b4f45c-c5cb-4888-b03c-c1bea313c3a9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:51.594636 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-52b4f45c-c5cb-4888-b03c-c1bea313c3a9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:51.595704 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-52b4f45c-c5cb-4888-b03c-c1bea313c3a9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:51.596383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-52b4f45c-c5cb-4888-b03c-c1bea313c3a9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:51.742299 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-52b4f45c-c5cb-4888-b03c-c1bea313c3a9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:51.752581 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-52b4f45c-c5cb-4888-b03c-c1bea313c3a9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.170636 Jun 06 21:07:51.753701 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 182/357] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:51 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:52.213766 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-acf6ce32-31d0-4f30-b818-352fc9f6e5a4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:52.214920 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-acf6ce32-31d0-4f30-b818-352fc9f6e5a4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:52.217443 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=4 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:52.228368 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-acf6ce32-31d0-4f30-b818-352fc9f6e5a4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:52.228859 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-acf6ce32-31d0-4f30-b818-352fc9f6e5a4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:52.229690 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-acf6ce32-31d0-4f30-b818-352fc9f6e5a4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:52.232512 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-acf6ce32-31d0-4f30-b818-352fc9f6e5a4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:52.452996 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-acf6ce32-31d0-4f30-b818-352fc9f6e5a4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:52.462119 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-acf6ce32-31d0-4f30-b818-352fc9f6e5a4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:52.463958 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-acf6ce32-31d0-4f30-b818-352fc9f6e5a4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:52.465502 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-acf6ce32-31d0-4f30-b818-352fc9f6e5a4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.256067 Jun 06 21:07:52.466132 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 176/358] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:52 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:52.775045 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-330f67b6-ba77-46de-aa0a-5d497762c190 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:52.775871 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-330f67b6-ba77-46de-aa0a-5d497762c190 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:52.782518 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-330f67b6-ba77-46de-aa0a-5d497762c190 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:52.782955 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-330f67b6-ba77-46de-aa0a-5d497762c190 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:52.783727 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-330f67b6-ba77-46de-aa0a-5d497762c190 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:52.784187 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-330f67b6-ba77-46de-aa0a-5d497762c190 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:52.972638 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-330f67b6-ba77-46de-aa0a-5d497762c190 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:52.984714 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-330f67b6-ba77-46de-aa0a-5d497762c190 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.213393 Jun 06 21:07:52.985783 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 183/359] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:52 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:53.483563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-ae42f417-1e55-4812-b34a-fd221db71561 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:53.485096 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-ae42f417-1e55-4812-b34a-fd221db71561 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:53.493158 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ae42f417-1e55-4812-b34a-fd221db71561 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:53.493984 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ae42f417-1e55-4812-b34a-fd221db71561 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:53.495712 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ae42f417-1e55-4812-b34a-fd221db71561 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:53.496826 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ae42f417-1e55-4812-b34a-fd221db71561 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:54.004076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3944ba49-c8d8-4b20-9822-90d96a126770 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:54.004867 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3944ba49-c8d8-4b20-9822-90d96a126770 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:54.021721 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3944ba49-c8d8-4b20-9822-90d96a126770 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:54.022472 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3944ba49-c8d8-4b20-9822-90d96a126770 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:54.022827 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3944ba49-c8d8-4b20-9822-90d96a126770 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:54.023755 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3944ba49-c8d8-4b20-9822-90d96a126770 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:54.060024 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-ae42f417-1e55-4812-b34a-fd221db71561 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:54.074699 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-ae42f417-1e55-4812-b34a-fd221db71561 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:54.076033 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-ae42f417-1e55-4812-b34a-fd221db71561 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:54.081652 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-ae42f417-1e55-4812-b34a-fd221db71561 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.602615 Jun 06 21:07:54.083067 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 177/360] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:53 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:54.207470 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3944ba49-c8d8-4b20-9822-90d96a126770 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:54.216780 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3944ba49-c8d8-4b20-9822-90d96a126770 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.217454 Jun 06 21:07:54.217878 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 184/361] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:53 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:07:55.107124 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e7a92fbd-493b-44de-80bb-dee3a6b48c1b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:55.108769 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-e7a92fbd-493b-44de-80bb-dee3a6b48c1b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:55.116379 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e7a92fbd-493b-44de-80bb-dee3a6b48c1b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:55.117125 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e7a92fbd-493b-44de-80bb-dee3a6b48c1b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:55.118076 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e7a92fbd-493b-44de-80bb-dee3a6b48c1b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:55.118500 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e7a92fbd-493b-44de-80bb-dee3a6b48c1b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:55.235259 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c8feb8d5-256d-4f68-87f4-ddf229486fda tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:55.236572 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c8feb8d5-256d-4f68-87f4-ddf229486fda tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:55.246046 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8feb8d5-256d-4f68-87f4-ddf229486fda tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:55.249187 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8feb8d5-256d-4f68-87f4-ddf229486fda tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:55.250507 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8feb8d5-256d-4f68-87f4-ddf229486fda tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:55.251303 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8feb8d5-256d-4f68-87f4-ddf229486fda tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:55.301363 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e7a92fbd-493b-44de-80bb-dee3a6b48c1b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:55.315953 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e7a92fbd-493b-44de-80bb-dee3a6b48c1b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:55.318592 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e7a92fbd-493b-44de-80bb-dee3a6b48c1b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:55.319802 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-e7a92fbd-493b-44de-80bb-dee3a6b48c1b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.217119 Jun 06 21:07:55.320496 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 178/362] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:55 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:55.464004 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c8feb8d5-256d-4f68-87f4-ddf229486fda tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:55.472082 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c8feb8d5-256d-4f68-87f4-ddf229486fda tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.240989 Jun 06 21:07:55.472665 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 185/363] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:55 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:07:56.349507 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-7e3a0300-030c-429f-a466-bee80926de29 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:56.350310 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-7e3a0300-030c-429f-a466-bee80926de29 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:56.354271 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:07:56.365774 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7e3a0300-030c-429f-a466-bee80926de29 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:56.366262 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7e3a0300-030c-429f-a466-bee80926de29 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:56.369364 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7e3a0300-030c-429f-a466-bee80926de29 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:56.370007 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7e3a0300-030c-429f-a466-bee80926de29 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:56.489151 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bf65c778-4c0d-4151-9db6-85cf9c018faf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:56.490503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bf65c778-4c0d-4151-9db6-85cf9c018faf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:56.499021 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf65c778-4c0d-4151-9db6-85cf9c018faf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:56.499577 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf65c778-4c0d-4151-9db6-85cf9c018faf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:56.505216 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf65c778-4c0d-4151-9db6-85cf9c018faf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:56.505557 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf65c778-4c0d-4151-9db6-85cf9c018faf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:56.565021 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-7e3a0300-030c-429f-a466-bee80926de29 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:56.575525 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-7e3a0300-030c-429f-a466-bee80926de29 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:56.577904 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-7e3a0300-030c-429f-a466-bee80926de29 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:56.579648 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-7e3a0300-030c-429f-a466-bee80926de29 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.244325 Jun 06 21:07:56.601527 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 179/364] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:56 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:56.689386 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bf65c778-4c0d-4151-9db6-85cf9c018faf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:56.701699 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bf65c778-4c0d-4151-9db6-85cf9c018faf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.215788 Jun 06 21:07:56.701952 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 186/365] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:56 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:57.609056 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-27c96f48-4752-41bf-b723-21810ebbd4a7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:57.609675 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-27c96f48-4752-41bf-b723-21810ebbd4a7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:57.623371 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-27c96f48-4752-41bf-b723-21810ebbd4a7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:57.623906 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-27c96f48-4752-41bf-b723-21810ebbd4a7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:57.624821 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-27c96f48-4752-41bf-b723-21810ebbd4a7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:57.625261 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-27c96f48-4752-41bf-b723-21810ebbd4a7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:57.718795 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f67e1b5f-6b81-42d8-98df-4abdd163fb13 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:57.719507 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f67e1b5f-6b81-42d8-98df-4abdd163fb13 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:57.728152 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f67e1b5f-6b81-42d8-98df-4abdd163fb13 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:57.729175 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f67e1b5f-6b81-42d8-98df-4abdd163fb13 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:57.730704 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f67e1b5f-6b81-42d8-98df-4abdd163fb13 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:57.731450 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f67e1b5f-6b81-42d8-98df-4abdd163fb13 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:57.853835 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-27c96f48-4752-41bf-b723-21810ebbd4a7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:57.866354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-27c96f48-4752-41bf-b723-21810ebbd4a7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:57.867846 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-27c96f48-4752-41bf-b723-21810ebbd4a7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:57.879224 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-27c96f48-4752-41bf-b723-21810ebbd4a7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.274316 Jun 06 21:07:57.879830 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 180/366] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:57 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:57.955942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f67e1b5f-6b81-42d8-98df-4abdd163fb13 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:57.965899 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f67e1b5f-6b81-42d8-98df-4abdd163fb13 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.250451 Jun 06 21:07:57.967359 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 187/367] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:57 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:07:58.899109 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-49715aea-112d-40b5-8e9d-25873838a839 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:58.900729 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-49715aea-112d-40b5-8e9d-25873838a839 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:58.908340 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-49715aea-112d-40b5-8e9d-25873838a839 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:58.908785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-49715aea-112d-40b5-8e9d-25873838a839 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:58.909557 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-49715aea-112d-40b5-8e9d-25873838a839 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:58.909989 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-49715aea-112d-40b5-8e9d-25873838a839 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:58.984945 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-090cedfd-5b92-4afe-9b32-faea1aecaf1f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:07:58.986402 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-090cedfd-5b92-4afe-9b32-faea1aecaf1f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:07:58.993907 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-090cedfd-5b92-4afe-9b32-faea1aecaf1f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:58.994698 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-090cedfd-5b92-4afe-9b32-faea1aecaf1f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:58.995740 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-090cedfd-5b92-4afe-9b32-faea1aecaf1f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:07:58.996490 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-090cedfd-5b92-4afe-9b32-faea1aecaf1f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:07:59.135019 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-49715aea-112d-40b5-8e9d-25873838a839 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:59.146664 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-49715aea-112d-40b5-8e9d-25873838a839 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:59.148231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-49715aea-112d-40b5-8e9d-25873838a839 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:59.149557 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-49715aea-112d-40b5-8e9d-25873838a839 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.255558 Jun 06 21:07:59.150844 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 181/368] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:07:58 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:07:59.183282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-090cedfd-5b92-4afe-9b32-faea1aecaf1f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:07:59.192123 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-090cedfd-5b92-4afe-9b32-faea1aecaf1f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.211029 Jun 06 21:07:59.192724 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 188/369] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:07:58 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:00.169277 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2711b7d6-5436-4e85-953f-3d8533982554 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:00.169959 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-2711b7d6-5436-4e85-953f-3d8533982554 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:00.177327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2711b7d6-5436-4e85-953f-3d8533982554 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:00.178179 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2711b7d6-5436-4e85-953f-3d8533982554 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:00.179199 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2711b7d6-5436-4e85-953f-3d8533982554 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:00.179907 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2711b7d6-5436-4e85-953f-3d8533982554 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:00.215631 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f09b4a4d-9cea-4387-ab86-9481d49a6a77 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:00.215631 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f09b4a4d-9cea-4387-ab86-9481d49a6a77 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:00.224533 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f09b4a4d-9cea-4387-ab86-9481d49a6a77 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:00.224974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f09b4a4d-9cea-4387-ab86-9481d49a6a77 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:00.225737 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f09b4a4d-9cea-4387-ab86-9481d49a6a77 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:00.226161 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f09b4a4d-9cea-4387-ab86-9481d49a6a77 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:00.410493 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2711b7d6-5436-4e85-953f-3d8533982554 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:00.432217 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2711b7d6-5436-4e85-953f-3d8533982554 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:00.432217 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2711b7d6-5436-4e85-953f-3d8533982554 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:00.432217 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-2711b7d6-5436-4e85-953f-3d8533982554 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.264983 Jun 06 21:08:00.432502 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 182/370] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:08:00 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:08:00.456592 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f09b4a4d-9cea-4387-ab86-9481d49a6a77 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:00.479811 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f09b4a4d-9cea-4387-ab86-9481d49a6a77 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.273163 Jun 06 21:08:00.480491 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 189/371] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:00 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:08:01.458484 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-044c454f-6563-4f0e-8887-c37faefd2f04 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:01.462443 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-044c454f-6563-4f0e-8887-c37faefd2f04 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:01.470535 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-044c454f-6563-4f0e-8887-c37faefd2f04 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:01.471298 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-044c454f-6563-4f0e-8887-c37faefd2f04 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:01.472398 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-044c454f-6563-4f0e-8887-c37faefd2f04 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:01.473000 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-044c454f-6563-4f0e-8887-c37faefd2f04 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:01.498391 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ccefb525-9d7a-4c8e-8971-83e69b06fff8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:01.499013 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ccefb525-9d7a-4c8e-8971-83e69b06fff8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:01.501392 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:01.515329 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ccefb525-9d7a-4c8e-8971-83e69b06fff8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:01.524513 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ccefb525-9d7a-4c8e-8971-83e69b06fff8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:01.525579 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ccefb525-9d7a-4c8e-8971-83e69b06fff8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:01.529457 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ccefb525-9d7a-4c8e-8971-83e69b06fff8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:01.737762 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ccefb525-9d7a-4c8e-8971-83e69b06fff8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:01.739215 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-044c454f-6563-4f0e-8887-c37faefd2f04 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:01.750829 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ccefb525-9d7a-4c8e-8971-83e69b06fff8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.256593 Jun 06 21:08:01.751382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 190/372] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:01 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:08:01.752467 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-044c454f-6563-4f0e-8887-c37faefd2f04 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:01.754652 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-044c454f-6563-4f0e-8887-c37faefd2f04 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:01.757795 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-044c454f-6563-4f0e-8887-c37faefd2f04 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.312691 Jun 06 21:08:01.764445 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 183/373] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:08:01 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:08:02.624496 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9e1ae084-cf11-4121-b8ed-4d70a8514733 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-267252449", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-408149276", "security_groups": [{"name": "tempest-secgroup-smoke-1513680457"}], "networks": [{"uuid": "ea12bf33-b22b-4649-bd13-a3fc1c1d2e2c"}], "block_device_mapping_v2": [{"uuid": "c5e56270-a186-4709-b3e3-0d04b9ff3ea3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:02.740868 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-9e1ae084-cf11-4121-b8ed-4d70a8514733 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] validate_networks() for [('ea12bf33-b22b-4649-bd13-a3fc1c1d2e2c', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 21:08:02.769547 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-bd3f0dae-f976-4ed1-993a-e31ad5478e1b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:02.770232 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-bd3f0dae-f976-4ed1-993a-e31ad5478e1b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:02.777635 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bd3f0dae-f976-4ed1-993a-e31ad5478e1b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:02.778065 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bd3f0dae-f976-4ed1-993a-e31ad5478e1b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:02.778822 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bd3f0dae-f976-4ed1-993a-e31ad5478e1b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:02.779243 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bd3f0dae-f976-4ed1-993a-e31ad5478e1b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:02.944394 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-bd3f0dae-f976-4ed1-993a-e31ad5478e1b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:02.952969 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-bd3f0dae-f976-4ed1-993a-e31ad5478e1b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.187824 Jun 06 21:08:02.953901 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 184/374] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:02 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:08:02.965928 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-19a56896-b3f0-4a11-8bfc-af997b6a65be tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:02.966531 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-19a56896-b3f0-4a11-8bfc-af997b6a65be tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:02.973350 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-19a56896-b3f0-4a11-8bfc-af997b6a65be tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:02.974499 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-19a56896-b3f0-4a11-8bfc-af997b6a65be tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:02.975277 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-19a56896-b3f0-4a11-8bfc-af997b6a65be tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:02.975708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-19a56896-b3f0-4a11-8bfc-af997b6a65be tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:03.113533 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-19a56896-b3f0-4a11-8bfc-af997b6a65be tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:03.123301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-19a56896-b3f0-4a11-8bfc-af997b6a65be tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:03.124823 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-19a56896-b3f0-4a11-8bfc-af997b6a65be tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:03.126031 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-19a56896-b3f0-4a11-8bfc-af997b6a65be tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.164520 Jun 06 21:08:03.126557 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 185/375] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:08:02 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:08:03.135760 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-9e1ae084-cf11-4121-b8ed-4d70a8514733 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 21:08:03.136297 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-9e1ae084-cf11-4121-b8ed-4d70a8514733 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 21:08:03.136832 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-9e1ae084-cf11-4121-b8ed-4d70a8514733 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 21:08:03.137244 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-9e1ae084-cf11-4121-b8ed-4d70a8514733 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 21:08:03.137661 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-9e1ae084-cf11-4121-b8ed-4d70a8514733 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 21:08:03.147085 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9e1ae084-cf11-4121-b8ed-4d70a8514733 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:03.147530 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9e1ae084-cf11-4121-b8ed-4d70a8514733 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:03.148368 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9e1ae084-cf11-4121-b8ed-4d70a8514733 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:03.148803 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9e1ae084-cf11-4121-b8ed-4d70a8514733 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:03.165742 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-9e1ae084-cf11-4121-b8ed-4d70a8514733 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Getting quotas for project 5a68679e2b3544bbb82f944fcae970ef. Resources: {'ram', 'cores', 'instances'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:08:03.170126 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-9e1ae084-cf11-4121-b8ed-4d70a8514733 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Getting quotas for user 36e865c93d844d8aa23661f779cd8e60 and project 5a68679e2b3544bbb82f944fcae970ef. Resources: {'ram', 'cores', 'instances'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:08:03.234387 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9e1ae084-cf11-4121-b8ed-4d70a8514733 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 21:08:03.236535 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9e1ae084-cf11-4121-b8ed-4d70a8514733 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c5e56270-a186-4709-b3e3-0d04b9ff3ea3',volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 21:08:03.380991 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9e1ae084-cf11-4121-b8ed-4d70a8514733 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.760685 Jun 06 21:08:03.381651 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 191/376] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 6 21:08:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 06 21:08:03.392230 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-ccd9eb98-8db1-4743-aa8e-13bf7f30e48c tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:03.392896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-ccd9eb98-8db1-4743-aa8e-13bf7f30e48c tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:03.450985 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-ccd9eb98-8db1-4743-aa8e-13bf7f30e48c tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:03.458170 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-ccd9eb98-8db1-4743-aa8e-13bf7f30e48c tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1087 microversion: 2.1 time: 0.069767 Jun 06 21:08:03.458781 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 186/377] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:03 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1087 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:03.659927 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4b4796f5-fd6c-47ff-98de-600fa8971118 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-782000225", "imageRef": "e4266a01-7d22-4036-91e8-3ec50e3369c1", "flavorRef": "452", "networks": [{"uuid": "cf86e52e-aa4a-463e-8a33-f4fd34970315"}]}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:03.716731 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-4b4796f5-fd6c-47ff-98de-600fa8971118 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] validate_networks() for [('cf86e52e-aa4a-463e-8a33-f4fd34970315', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 21:08:03.971113 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-359d4acf-908d-4ad8-a972-8c3138aa3c78 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:03.971683 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-359d4acf-908d-4ad8-a972-8c3138aa3c78 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:03.980185 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-359d4acf-908d-4ad8-a972-8c3138aa3c78 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:03.981128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-359d4acf-908d-4ad8-a972-8c3138aa3c78 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:03.981976 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-359d4acf-908d-4ad8-a972-8c3138aa3c78 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:03.982852 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-359d4acf-908d-4ad8-a972-8c3138aa3c78 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:04.097941 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-4b4796f5-fd6c-47ff-98de-600fa8971118 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 21:08:04.098611 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-4b4796f5-fd6c-47ff-98de-600fa8971118 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 21:08:04.099220 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-4b4796f5-fd6c-47ff-98de-600fa8971118 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 21:08:04.099687 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-4b4796f5-fd6c-47ff-98de-600fa8971118 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 21:08:04.100216 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-4b4796f5-fd6c-47ff-98de-600fa8971118 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 21:08:04.110503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b4796f5-fd6c-47ff-98de-600fa8971118 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:04.111044 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b4796f5-fd6c-47ff-98de-600fa8971118 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:04.111921 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b4796f5-fd6c-47ff-98de-600fa8971118 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:04.112460 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b4796f5-fd6c-47ff-98de-600fa8971118 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:04.130981 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-4b4796f5-fd6c-47ff-98de-600fa8971118 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Getting quotas for project a00a423b890b4dc0b4410220da7cdaa8. Resources: {'ram', 'cores', 'instances'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:08:04.135150 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-359d4acf-908d-4ad8-a972-8c3138aa3c78 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:04.135332 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-4b4796f5-fd6c-47ff-98de-600fa8971118 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Getting quotas for user 3f74038b57aa477283f7c8fabebd19be and project a00a423b890b4dc0b4410220da7cdaa8. Resources: {'ram', 'cores', 'instances'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:08:04.144473 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-359d4acf-908d-4ad8-a972-8c3138aa3c78 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.177388 Jun 06 21:08:04.145045 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 187/378] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:03 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:04.147881 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4b4796f5-fd6c-47ff-98de-600fa8971118 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 21:08:04.149840 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-267a712c-260c-4c2b-99c7-5b0dea19350f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:04.150231 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4b4796f5-fd6c-47ff-98de-600fa8971118 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4266a01-7d22-4036-91e8-3ec50e3369c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 21:08:04.150462 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-267a712c-260c-4c2b-99c7-5b0dea19350f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:04.156930 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-267a712c-260c-4c2b-99c7-5b0dea19350f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:04.157355 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-267a712c-260c-4c2b-99c7-5b0dea19350f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:04.158146 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-267a712c-260c-4c2b-99c7-5b0dea19350f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:04.158565 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-267a712c-260c-4c2b-99c7-5b0dea19350f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:04.199086 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4b4796f5-fd6c-47ff-98de-600fa8971118 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543969 Jun 06 21:08:04.200127 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 192/379] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 6 21:08:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 21:08:04.211828 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-41adfce0-0f38-4f0a-819a-0d9d247915c4 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:04.212432 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-41adfce0-0f38-4f0a-819a-0d9d247915c4 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:04.284906 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-41adfce0-0f38-4f0a-819a-0d9d247915c4 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:04.294770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-41adfce0-0f38-4f0a-819a-0d9d247915c4 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1218 microversion: 2.1 time: 0.087857 Jun 06 21:08:04.308174 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 193/380] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:04 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:04.310398 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-267a712c-260c-4c2b-99c7-5b0dea19350f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:04.333099 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-267a712c-260c-4c2b-99c7-5b0dea19350f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:04.334332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-267a712c-260c-4c2b-99c7-5b0dea19350f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:04.335868 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-267a712c-260c-4c2b-99c7-5b0dea19350f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.189879 Jun 06 21:08:04.340537 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 188/381] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:08:04 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:08:04.477259 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b4f0acf5-5677-4487-8e28-a7c58c67eddf tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:04.477956 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b4f0acf5-5677-4487-8e28-a7c58c67eddf tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:04.486725 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4f0acf5-5677-4487-8e28-a7c58c67eddf tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:04.487385 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4f0acf5-5677-4487-8e28-a7c58c67eddf tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:04.488433 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4f0acf5-5677-4487-8e28-a7c58c67eddf tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:04.489055 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b4f0acf5-5677-4487-8e28-a7c58c67eddf tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:04.566726 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b4f0acf5-5677-4487-8e28-a7c58c67eddf tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:04.575657 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b4f0acf5-5677-4487-8e28-a7c58c67eddf tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1203 microversion: 2.1 time: 0.102761 Jun 06 21:08:04.576880 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 194/382] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:04 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1203 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:05.168580 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-7378daf3-b32c-4eb7-b853-7b0c534fcd9f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:05.173293 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-7378daf3-b32c-4eb7-b853-7b0c534fcd9f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:05.186925 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7378daf3-b32c-4eb7-b853-7b0c534fcd9f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:05.187362 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7378daf3-b32c-4eb7-b853-7b0c534fcd9f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:05.188199 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7378daf3-b32c-4eb7-b853-7b0c534fcd9f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:05.188635 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7378daf3-b32c-4eb7-b853-7b0c534fcd9f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:05.314119 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-387af1a1-2267-4e14-8868-d8aef0a54b7d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:05.315330 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-387af1a1-2267-4e14-8868-d8aef0a54b7d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:05.330426 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-387af1a1-2267-4e14-8868-d8aef0a54b7d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:05.331055 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-387af1a1-2267-4e14-8868-d8aef0a54b7d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:05.332700 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-387af1a1-2267-4e14-8868-d8aef0a54b7d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:05.333418 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-387af1a1-2267-4e14-8868-d8aef0a54b7d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:05.509052 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-7378daf3-b32c-4eb7-b853-7b0c534fcd9f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:05.518226 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-7378daf3-b32c-4eb7-b853-7b0c534fcd9f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.359937 Jun 06 21:08:05.521967 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 189/383] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:05 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:05.527185 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-5000984c-4d34-4b9b-9d04-208d1401391e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:05.528086 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-5000984c-4d34-4b9b-9d04-208d1401391e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:05.541549 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5000984c-4d34-4b9b-9d04-208d1401391e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:05.542338 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5000984c-4d34-4b9b-9d04-208d1401391e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:05.544162 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5000984c-4d34-4b9b-9d04-208d1401391e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:05.544820 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5000984c-4d34-4b9b-9d04-208d1401391e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:05.558156 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-387af1a1-2267-4e14-8868-d8aef0a54b7d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:05.569569 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-387af1a1-2267-4e14-8868-d8aef0a54b7d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1288 microversion: 2.1 time: 0.259906 Jun 06 21:08:05.570174 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 195/384] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:05 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1288 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:05.595851 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-59d7e829-293e-472f-91b3-e86df4e25b9f tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:05.596509 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-59d7e829-293e-472f-91b3-e86df4e25b9f tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:05.604024 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59d7e829-293e-472f-91b3-e86df4e25b9f tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:05.604466 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59d7e829-293e-472f-91b3-e86df4e25b9f tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:05.605915 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59d7e829-293e-472f-91b3-e86df4e25b9f tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:05.608089 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59d7e829-293e-472f-91b3-e86df4e25b9f tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:05.836154 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-5000984c-4d34-4b9b-9d04-208d1401391e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:05.846913 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-5000984c-4d34-4b9b-9d04-208d1401391e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:05.848770 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-5000984c-4d34-4b9b-9d04-208d1401391e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:05.850128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-5000984c-4d34-4b9b-9d04-208d1401391e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.326748 Jun 06 21:08:05.850969 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 190/385] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:08:05 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:08:06.109078 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-59d7e829-293e-472f-91b3-e86df4e25b9f tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:06.149122 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-59d7e829-293e-472f-91b3-e86df4e25b9f tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1259 microversion: 2.1 time: 0.557807 Jun 06 21:08:06.149781 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 196/386] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:05 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1259 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:06.323830 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-494ae0d3-b79a-486b-9071-3c3c1a997822 req-0689d0d7-7b82-45c9-a0a6-7340e593af25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807baad3-4d23-4d63-b4a9-7163fc77e302", "tag": "98717e19-2897-4922-9eb5-8ca664fad7a8"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:06.335900 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-494ae0d3-b79a-486b-9071-3c3c1a997822 req-0689d0d7-7b82-45c9-a0a6-7340e593af25 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:06.336354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-494ae0d3-b79a-486b-9071-3c3c1a997822 req-0689d0d7-7b82-45c9-a0a6-7340e593af25 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:06.354449 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-494ae0d3-b79a-486b-9071-3c3c1a997822 req-0689d0d7-7b82-45c9-a0a6-7340e593af25 service nova] Creating event network-changed:98717e19-2897-4922-9eb5-8ca664fad7a8 for instance 807baad3-4d23-4d63-b4a9-7163fc77e302 on hv-cinder-84488 Jun 06 21:08:06.361651 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-494ae0d3-b79a-486b-9071-3c3c1a997822 req-0689d0d7-7b82-45c9-a0a6-7340e593af25 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042052 Jun 06 21:08:06.362474 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 191/387] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:08:06.543060 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-04689d01-0eb6-4ee9-ba19-847d4432899e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:06.543672 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-04689d01-0eb6-4ee9-ba19-847d4432899e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:06.552679 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-04689d01-0eb6-4ee9-ba19-847d4432899e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:06.553405 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-04689d01-0eb6-4ee9-ba19-847d4432899e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:06.554372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-04689d01-0eb6-4ee9-ba19-847d4432899e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:06.554958 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-04689d01-0eb6-4ee9-ba19-847d4432899e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:06.591267 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-59fda2b6-84bb-4b24-b3e8-b81176615017 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:06.592283 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-59fda2b6-84bb-4b24-b3e8-b81176615017 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:06.605579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-59fda2b6-84bb-4b24-b3e8-b81176615017 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:06.609319 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-59fda2b6-84bb-4b24-b3e8-b81176615017 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:06.610248 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-59fda2b6-84bb-4b24-b3e8-b81176615017 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:06.610690 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-59fda2b6-84bb-4b24-b3e8-b81176615017 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:06.831315 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-04689d01-0eb6-4ee9-ba19-847d4432899e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:06.845029 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-04689d01-0eb6-4ee9-ba19-847d4432899e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.305978 Jun 06 21:08:06.845814 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 197/388] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:06 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:06.855080 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-59fda2b6-84bb-4b24-b3e8-b81176615017 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:06.859049 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-59fda2b6-84bb-4b24-b3e8-b81176615017 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1318 microversion: 2.1 time: 0.273208 Jun 06 21:08:06.859701 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 192/389] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:06 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:08:06.869137 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8bab1aab-2cdd-4686-a304-f5dc39829cae tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:06.869813 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8bab1aab-2cdd-4686-a304-f5dc39829cae tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:06.876662 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8bab1aab-2cdd-4686-a304-f5dc39829cae tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:06.876662 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8bab1aab-2cdd-4686-a304-f5dc39829cae tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:06.877579 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8bab1aab-2cdd-4686-a304-f5dc39829cae tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:06.878382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8bab1aab-2cdd-4686-a304-f5dc39829cae tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:07.099894 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8bab1aab-2cdd-4686-a304-f5dc39829cae tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:07.111242 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8bab1aab-2cdd-4686-a304-f5dc39829cae tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:07.113025 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8bab1aab-2cdd-4686-a304-f5dc39829cae tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:07.114750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8bab1aab-2cdd-4686-a304-f5dc39829cae tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.249619 Jun 06 21:08:07.115428 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 198/390] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:08:06 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:08:07.167787 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-8666aa09-d0df-4732-947b-436a751b663d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:07.168811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-8666aa09-d0df-4732-947b-436a751b663d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:07.175643 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8666aa09-d0df-4732-947b-436a751b663d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:07.176582 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8666aa09-d0df-4732-947b-436a751b663d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:07.177649 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8666aa09-d0df-4732-947b-436a751b663d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:07.178174 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8666aa09-d0df-4732-947b-436a751b663d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:07.394567 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-1bb0f01a-2c95-4df7-bc1b-881fa0b23ad4 req-77eb4c28-75db-4b25-8673-e498e66d26ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b2b83bd-e8cf-4d4e-8048-20336a5d21e5", "tag": "8ebfa5e0-f4fb-4ca5-a0c9-947b5ca291f7"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:07.396269 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-8666aa09-d0df-4732-947b-436a751b663d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:07.406276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-1bb0f01a-2c95-4df7-bc1b-881fa0b23ad4 req-77eb4c28-75db-4b25-8673-e498e66d26ab service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:07.406748 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-1bb0f01a-2c95-4df7-bc1b-881fa0b23ad4 req-77eb4c28-75db-4b25-8673-e498e66d26ab service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:07.408102 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-8666aa09-d0df-4732-947b-436a751b663d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1259 microversion: 2.1 time: 0.243749 Jun 06 21:08:07.415553 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 193/391] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:07 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1259 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:07.420067 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-1bb0f01a-2c95-4df7-bc1b-881fa0b23ad4 req-77eb4c28-75db-4b25-8673-e498e66d26ab service nova] Creating event network-changed:8ebfa5e0-f4fb-4ca5-a0c9-947b5ca291f7 for instance 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 on hv-cinder-84488 Jun 06 21:08:07.425735 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-1bb0f01a-2c95-4df7-bc1b-881fa0b23ad4 req-77eb4c28-75db-4b25-8673-e498e66d26ab service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035222 Jun 06 21:08:07.426330 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 199/392] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:08:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:08:07.862406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0a79d620-9b36-49d1-b8fe-79d4f481c124 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:07.863206 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-0a79d620-9b36-49d1-b8fe-79d4f481c124 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:07.871046 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0a79d620-9b36-49d1-b8fe-79d4f481c124 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:07.871711 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0a79d620-9b36-49d1-b8fe-79d4f481c124 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:07.873255 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0a79d620-9b36-49d1-b8fe-79d4f481c124 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:07.873876 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0a79d620-9b36-49d1-b8fe-79d4f481c124 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:07.879672 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d62d5f7e-3788-422b-b830-34dbe8208dc9 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:07.880339 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d62d5f7e-3788-422b-b830-34dbe8208dc9 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:07.887158 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d62d5f7e-3788-422b-b830-34dbe8208dc9 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:07.888026 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d62d5f7e-3788-422b-b830-34dbe8208dc9 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:07.889053 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d62d5f7e-3788-422b-b830-34dbe8208dc9 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:07.889627 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d62d5f7e-3788-422b-b830-34dbe8208dc9 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:08.029357 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d62d5f7e-3788-422b-b830-34dbe8208dc9 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:08.031635 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:08.038927 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d62d5f7e-3788-422b-b830-34dbe8208dc9 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1318 microversion: 2.1 time: 0.164700 Jun 06 21:08:08.039800 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 200/393] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:07 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:08.044416 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-0a79d620-9b36-49d1-b8fe-79d4f481c124 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:08.052517 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-0a79d620-9b36-49d1-b8fe-79d4f481c124 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.194036 Jun 06 21:08:08.053088 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 194/394] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:07 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:08.136879 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0f9c8361-09a0-4b9e-8414-2581176da8db tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:08.137387 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0f9c8361-09a0-4b9e-8414-2581176da8db tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:08.144243 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f9c8361-09a0-4b9e-8414-2581176da8db tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:08.144804 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f9c8361-09a0-4b9e-8414-2581176da8db tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:08.145596 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f9c8361-09a0-4b9e-8414-2581176da8db tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:08.146020 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0f9c8361-09a0-4b9e-8414-2581176da8db tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:08.228204 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-f2b5f6b0-b664-4403-b042-4241c794cdf5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:08.228704 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-f2b5f6b0-b664-4403-b042-4241c794cdf5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:08.242858 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f2b5f6b0-b664-4403-b042-4241c794cdf5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:08.243291 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f2b5f6b0-b664-4403-b042-4241c794cdf5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:08.244089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f2b5f6b0-b664-4403-b042-4241c794cdf5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:08.244703 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f2b5f6b0-b664-4403-b042-4241c794cdf5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:08.273275 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-f2b5f6b0-b664-4403-b042-4241c794cdf5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13/ips" status: 200 len: 151 microversion: 2.1 time: 0.049054 Jun 06 21:08:08.274025 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 195/395] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jun 6 21:08:08 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13/ips => generated 151 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:08:08.285058 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-1034e8d5-ade2-4216-896a-1940c3bcc933 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0aae6ddd-8aed-4286-9ebd-c429736820bf"}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:08.286199 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-1034e8d5-ade2-4216-896a-1940c3bcc933 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:08.286325 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0f9c8361-09a0-4b9e-8414-2581176da8db tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:08.292498 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1034e8d5-ade2-4216-896a-1940c3bcc933 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:08.293149 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1034e8d5-ade2-4216-896a-1940c3bcc933 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:08.293921 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1034e8d5-ade2-4216-896a-1940c3bcc933 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:08.294340 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1034e8d5-ade2-4216-896a-1940c3bcc933 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:08.295161 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0f9c8361-09a0-4b9e-8414-2581176da8db tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:08.296733 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0f9c8361-09a0-4b9e-8414-2581176da8db tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:08.297908 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0f9c8361-09a0-4b9e-8414-2581176da8db tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.165926 Jun 06 21:08:08.298478 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 201/396] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:08:08 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:08:08.387009 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-1034e8d5-ade2-4216-896a-1940c3bcc933 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] HTTP exception thrown: Invalid volume: volume 0aae6ddd-8aed-4286-9ebd-c429736820bf is already attached to instances: 67813627-cc4f-453f-8b8f-9cec9b130583 Jun 06 21:08:08.388723 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-1034e8d5-ade2-4216-896a-1940c3bcc933 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Request method failure captured: Jun 06 21:08:08.388723 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: POST /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13/os-volume_attachments HTTP/1.1 Jun 06 21:08:08.388723 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:08:08.388723 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:08:08.388723 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:08:08.388723 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 74 Jun 06 21:08:08.388723 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:08:08.388723 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:08:08.388723 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:08:08.388723 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:08:08.388723 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinmvxW1bVEWZVhCRlgeG6PDmaOvHpznA6mf68h7fAFngISNh4GnD9XFqvo52ymtA4PTaTSN-lCxDTYk7dFVIPU5elkSuX6Hf8rm-_SR1iR7N3wUEkc6KR6wmwlcMFMA3l3v8mmff7I1soQTiyS_qgppqz32gWX7gOKmiYav_WF1YU4TA Jun 06 21:08:08.388723 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:08:08.388723 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:08:08.388723 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:08:08.388723 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:08:08.388723 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:08:08.388723 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:08:08.388723 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:08:08.388723 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:08:08.388723 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:08:08.388723 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:08:08.390350 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:08:08.390350 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:08:08.390350 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:08:08.390350 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:08:08.390350 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:08:08.390350 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:08:08.390350 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:08:08.390350 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: 8713cb23a93147f8b52f88e240c81d6f Jun 06 21:08:08.390350 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:08:08.390350 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Jun 06 21:08:08.390350 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {"volumeAttachment": {"volumeId": "0aae6ddd-8aed-4286-9ebd-c429736820bf"}} Jun 06 21:08:08.390350 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: > Jun 06 21:08:08.391314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Invalid volume: volume 0aae6ddd-8aed-4286-9ebd-c429736820bf is already attached to instances: 67813627-cc4f-453f-8b8f-9cec9b130583 Jun 06 21:08:08.391314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'server_id': '8a6a1d28-5f70-418f-8991-139855579e13', 'body': {'volumeAttachment': {'volumeId': '0aae6ddd-8aed-4286-9ebd-c429736820bf'}}} Jun 06 21:08:08.391314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:08:08.391314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:08:08.391314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 06 21:08:08.391314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 06 21:08:08.391314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 21:08:08.391314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 21:08:08.391314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 06 21:08:08.391314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 06 21:08:08.391314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 06 21:08:08.391314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 06 21:08:08.391314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 06 21:08:08.391314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 06 21:08:08.391314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 0aae6ddd-8aed-4286-9ebd-c429736820bf is already attached to instances: 67813627-cc4f-453f-8b8f-9cec9b130583 Jun 06 21:08:08.391314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:08:08.391314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:08:08.391314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:08:08.391314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:08:08.392612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:08:08.392612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:08:08.392612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:08:08.392612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:08:08.392612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:08:08.392612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:08:08.392612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 21:08:08.392612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 21:08:08.392612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 21:08:08.392612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 21:08:08.392612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 21:08:08.392612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 21:08:08.392612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 06 21:08:08.392612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 06 21:08:08.392612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 0aae6ddd-8aed-4286-9ebd-c429736820bf is already attached to instances: 67813627-cc4f-453f-8b8f-9cec9b130583 Jun 06 21:08:08.392612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:08:08.392612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:08:08.392612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:08:08.392612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:08:08.392612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:08:08.393781 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:08:08.393781 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:08:08.393781 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:08:08.393781 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 0aae6ddd-8aed-4286-9ebd-c429736820bf is already attached to instances: 67813627-cc4f-453f-8b8f-9cec9b130583 Jun 06 21:08:08.393781 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:08:08.393781 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-1034e8d5-ade2-4216-896a-1940c3bcc933 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Returning 400 to user: Invalid volume: volume 0aae6ddd-8aed-4286-9ebd-c429736820bf is already attached to instances: 67813627-cc4f-453f-8b8f-9cec9b130583 {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:08:08.393781 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-1034e8d5-ade2-4216-896a-1940c3bcc933 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "POST /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109156 Jun 06 21:08:08.393781 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 196/397] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 6 21:08:08 2022] POST /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 06 21:08:08.399646 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-72877a65-e79c-4580-85d3-070fe4eb46cb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:08.400181 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-72877a65-e79c-4580-85d3-070fe4eb46cb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:08.406447 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72877a65-e79c-4580-85d3-070fe4eb46cb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:08.406891 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72877a65-e79c-4580-85d3-070fe4eb46cb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:08.407639 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72877a65-e79c-4580-85d3-070fe4eb46cb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:08.408122 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72877a65-e79c-4580-85d3-070fe4eb46cb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:08.432155 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-1a42b2d7-5491-4ecb-ba6d-0773e9c6a004 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:08.432846 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-1a42b2d7-5491-4ecb-ba6d-0773e9c6a004 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:08.433154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-72877a65-e79c-4580-85d3-070fe4eb46cb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 21:08:08.440671 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1a42b2d7-5491-4ecb-ba6d-0773e9c6a004 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:08.441115 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1a42b2d7-5491-4ecb-ba6d-0773e9c6a004 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:08.441880 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1a42b2d7-5491-4ecb-ba6d-0773e9c6a004 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:08.442300 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1a42b2d7-5491-4ecb-ba6d-0773e9c6a004 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:08.502907 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:08.524703 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-72877a65-e79c-4580-85d3-070fe4eb46cb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 204 len: 0 microversion: 2.1 time: 0.128592 Jun 06 21:08:08.525401 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 202/398] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:08:08 2022] DELETE /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 21:08:08.534612 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4a562f18-5efc-4103-b27f-20fdc04ee0a2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:08.535304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4a562f18-5efc-4103-b27f-20fdc04ee0a2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:08.541429 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a562f18-5efc-4103-b27f-20fdc04ee0a2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:08.541877 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a562f18-5efc-4103-b27f-20fdc04ee0a2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:08.542753 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a562f18-5efc-4103-b27f-20fdc04ee0a2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:08.543812 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a562f18-5efc-4103-b27f-20fdc04ee0a2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:08.583629 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-1a42b2d7-5491-4ecb-ba6d-0773e9c6a004 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:08.592755 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-1a42b2d7-5491-4ecb-ba6d-0773e9c6a004 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1259 microversion: 2.1 time: 0.164514 Jun 06 21:08:08.593346 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 197/399] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:08 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:08.682056 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4a562f18-5efc-4103-b27f-20fdc04ee0a2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:08.689681 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4a562f18-5efc-4103-b27f-20fdc04ee0a2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1683 microversion: 2.1 time: 0.159127 Jun 06 21:08:08.690242 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 203/400] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:08 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:08:09.055308 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-61a72529-1455-4d91-97bd-19f9f92b9219 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:09.055953 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-61a72529-1455-4d91-97bd-19f9f92b9219 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:09.062749 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-61a72529-1455-4d91-97bd-19f9f92b9219 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:09.063194 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-61a72529-1455-4d91-97bd-19f9f92b9219 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:09.063948 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-61a72529-1455-4d91-97bd-19f9f92b9219 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:09.064410 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-61a72529-1455-4d91-97bd-19f9f92b9219 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:09.070866 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7be730de-add4-4a74-866d-8a1d8a7d2490 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:09.071468 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7be730de-add4-4a74-866d-8a1d8a7d2490 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:09.079174 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7be730de-add4-4a74-866d-8a1d8a7d2490 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:09.079617 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7be730de-add4-4a74-866d-8a1d8a7d2490 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:09.080404 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7be730de-add4-4a74-866d-8a1d8a7d2490 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:09.080830 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7be730de-add4-4a74-866d-8a1d8a7d2490 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:09.199922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-61a72529-1455-4d91-97bd-19f9f92b9219 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:09.208132 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-61a72529-1455-4d91-97bd-19f9f92b9219 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1318 microversion: 2.1 time: 0.156704 Jun 06 21:08:09.208721 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 198/401] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:09 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:09.218090 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7be730de-add4-4a74-866d-8a1d8a7d2490 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:09.225753 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7be730de-add4-4a74-866d-8a1d8a7d2490 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.158731 Jun 06 21:08:09.226323 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 204/402] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:09 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:09.320955 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e7e56a82-a01c-4bf3-ac5f-2a4bfb816631 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:09.321943 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-e7e56a82-a01c-4bf3-ac5f-2a4bfb816631 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:09.333251 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e7e56a82-a01c-4bf3-ac5f-2a4bfb816631 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:09.334057 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e7e56a82-a01c-4bf3-ac5f-2a4bfb816631 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:09.335462 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e7e56a82-a01c-4bf3-ac5f-2a4bfb816631 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:09.336287 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e7e56a82-a01c-4bf3-ac5f-2a4bfb816631 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:09.483641 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e7e56a82-a01c-4bf3-ac5f-2a4bfb816631 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:09.492554 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e7e56a82-a01c-4bf3-ac5f-2a4bfb816631 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:09.494044 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e7e56a82-a01c-4bf3-ac5f-2a4bfb816631 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:09.495205 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-e7e56a82-a01c-4bf3-ac5f-2a4bfb816631 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.181832 Jun 06 21:08:09.495759 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 199/403] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:08:09 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:08:09.610549 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-185187ab-2db2-49f0-aeb3-2ad8af570a24 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:09.611385 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-185187ab-2db2-49f0-aeb3-2ad8af570a24 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:09.618592 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-185187ab-2db2-49f0-aeb3-2ad8af570a24 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:09.619066 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-185187ab-2db2-49f0-aeb3-2ad8af570a24 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:09.619820 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-185187ab-2db2-49f0-aeb3-2ad8af570a24 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:09.620340 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-185187ab-2db2-49f0-aeb3-2ad8af570a24 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:09.708953 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-8fb49a5e-4b57-43b8-82a9-f1930651c5b1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:09.709674 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-8fb49a5e-4b57-43b8-82a9-f1930651c5b1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:09.716998 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8fb49a5e-4b57-43b8-82a9-f1930651c5b1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:09.717589 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8fb49a5e-4b57-43b8-82a9-f1930651c5b1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:09.718396 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8fb49a5e-4b57-43b8-82a9-f1930651c5b1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:09.718826 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8fb49a5e-4b57-43b8-82a9-f1930651c5b1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:09.759481 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-185187ab-2db2-49f0-aeb3-2ad8af570a24 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:09.768038 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-185187ab-2db2-49f0-aeb3-2ad8af570a24 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1259 microversion: 2.1 time: 0.161512 Jun 06 21:08:09.768661 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 205/404] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:09 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:09.853897 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-8fb49a5e-4b57-43b8-82a9-f1930651c5b1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:09.866230 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-8fb49a5e-4b57-43b8-82a9-f1930651c5b1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1683 microversion: 2.1 time: 0.160975 Jun 06 21:08:09.866857 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 200/405] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:09 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:10.228555 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1f31838e-89f4-4f44-b1d0-a3e24e63ef5a tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:10.229341 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1f31838e-89f4-4f44-b1d0-a3e24e63ef5a tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:10.236705 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1f31838e-89f4-4f44-b1d0-a3e24e63ef5a tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:10.237153 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1f31838e-89f4-4f44-b1d0-a3e24e63ef5a tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:10.237923 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1f31838e-89f4-4f44-b1d0-a3e24e63ef5a tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:10.238347 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1f31838e-89f4-4f44-b1d0-a3e24e63ef5a tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:10.244536 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-1cbb3c1e-0b11-4ba1-b119-5f9a699c95c1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:10.245159 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-1cbb3c1e-0b11-4ba1-b119-5f9a699c95c1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:10.251746 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1cbb3c1e-0b11-4ba1-b119-5f9a699c95c1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:10.252286 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1cbb3c1e-0b11-4ba1-b119-5f9a699c95c1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:10.253028 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1cbb3c1e-0b11-4ba1-b119-5f9a699c95c1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:10.253462 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1cbb3c1e-0b11-4ba1-b119-5f9a699c95c1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:10.373989 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1f31838e-89f4-4f44-b1d0-a3e24e63ef5a tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:10.381912 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1f31838e-89f4-4f44-b1d0-a3e24e63ef5a tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1318 microversion: 2.1 time: 0.159549 Jun 06 21:08:10.382742 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 206/406] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:10 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:10.383739 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-1cbb3c1e-0b11-4ba1-b119-5f9a699c95c1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:10.392307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-1cbb3c1e-0b11-4ba1-b119-5f9a699c95c1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.151255 Jun 06 21:08:10.393025 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 201/407] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:10 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:10.515954 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3bf78469-a714-4e10-b6d7-857520d13fd4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:10.516564 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3bf78469-a714-4e10-b6d7-857520d13fd4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:10.535395 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3bf78469-a714-4e10-b6d7-857520d13fd4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:10.536046 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3bf78469-a714-4e10-b6d7-857520d13fd4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:10.537326 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3bf78469-a714-4e10-b6d7-857520d13fd4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:10.538131 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3bf78469-a714-4e10-b6d7-857520d13fd4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:10.690403 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3bf78469-a714-4e10-b6d7-857520d13fd4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:10.700332 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3bf78469-a714-4e10-b6d7-857520d13fd4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:10.701919 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3bf78469-a714-4e10-b6d7-857520d13fd4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:10.703447 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3bf78469-a714-4e10-b6d7-857520d13fd4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.192400 Jun 06 21:08:10.704020 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 207/408] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:08:10 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:08:10.788117 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-da81acc3-dced-41b7-9255-c9d10f7cfd17 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:10.789073 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-da81acc3-dced-41b7-9255-c9d10f7cfd17 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:10.796907 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-da81acc3-dced-41b7-9255-c9d10f7cfd17 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:10.797390 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-da81acc3-dced-41b7-9255-c9d10f7cfd17 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:10.798164 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-da81acc3-dced-41b7-9255-c9d10f7cfd17 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:10.798589 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-da81acc3-dced-41b7-9255-c9d10f7cfd17 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:10.801633 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=100 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:10.889422 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f8588171-46a9-4373-974b-016a39c18ad6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:10.892293 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f8588171-46a9-4373-974b-016a39c18ad6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:10.903148 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8588171-46a9-4373-974b-016a39c18ad6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:10.903588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8588171-46a9-4373-974b-016a39c18ad6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:10.904390 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8588171-46a9-4373-974b-016a39c18ad6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:10.904812 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f8588171-46a9-4373-974b-016a39c18ad6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:10.958968 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-da81acc3-dced-41b7-9255-c9d10f7cfd17 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:10.967949 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-da81acc3-dced-41b7-9255-c9d10f7cfd17 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1259 microversion: 2.1 time: 0.185462 Jun 06 21:08:10.968608 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 202/409] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:10 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:11.046931 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f8588171-46a9-4373-974b-016a39c18ad6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:11.060603 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f8588171-46a9-4373-974b-016a39c18ad6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1683 microversion: 2.1 time: 0.178258 Jun 06 21:08:11.061649 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 208/410] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:10 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1683 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:11.399418 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-4a9c5589-e32a-4769-a237-88901412ba86 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:11.399928 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-4a9c5589-e32a-4769-a237-88901412ba86 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:11.407595 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4a9c5589-e32a-4769-a237-88901412ba86 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:11.408065 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4a9c5589-e32a-4769-a237-88901412ba86 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:11.408839 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4a9c5589-e32a-4769-a237-88901412ba86 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:11.409263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4a9c5589-e32a-4769-a237-88901412ba86 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:11.410024 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-39bb2ca5-1c15-4eef-ae79-1a005122643f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:11.410822 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-39bb2ca5-1c15-4eef-ae79-1a005122643f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:11.417673 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-39bb2ca5-1c15-4eef-ae79-1a005122643f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:11.418196 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-39bb2ca5-1c15-4eef-ae79-1a005122643f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:11.419078 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-39bb2ca5-1c15-4eef-ae79-1a005122643f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:11.419522 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-39bb2ca5-1c15-4eef-ae79-1a005122643f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:11.546718 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-4a9c5589-e32a-4769-a237-88901412ba86 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:11.557692 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-4a9c5589-e32a-4769-a237-88901412ba86 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1318 microversion: 2.1 time: 0.162696 Jun 06 21:08:11.558196 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-39bb2ca5-1c15-4eef-ae79-1a005122643f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:11.560550 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 203/411] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:11 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:08:11.565852 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-39bb2ca5-1c15-4eef-ae79-1a005122643f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.159703 Jun 06 21:08:11.566455 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 209/412] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:11 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:11.656380 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 21:08:11.656615 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Mon Jun 6 21:08:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 21:08:11.722098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2e54b9f4-41d9-41fe-a658-5f841eb32b98 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:11.722700 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-2e54b9f4-41d9-41fe-a658-5f841eb32b98 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:11.731271 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2e54b9f4-41d9-41fe-a658-5f841eb32b98 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:11.731715 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2e54b9f4-41d9-41fe-a658-5f841eb32b98 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:11.732515 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2e54b9f4-41d9-41fe-a658-5f841eb32b98 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:11.732941 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2e54b9f4-41d9-41fe-a658-5f841eb32b98 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:11.883125 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2e54b9f4-41d9-41fe-a658-5f841eb32b98 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:11.892246 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2e54b9f4-41d9-41fe-a658-5f841eb32b98 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:11.893753 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2e54b9f4-41d9-41fe-a658-5f841eb32b98 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:11.894911 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-2e54b9f4-41d9-41fe-a658-5f841eb32b98 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.176786 Jun 06 21:08:11.895502 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 204/413] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:08:11 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:08:11.985167 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3681fa66-d7ac-4618-9dc8-5629d65acc9a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:11.985683 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3681fa66-d7ac-4618-9dc8-5629d65acc9a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:11.992717 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3681fa66-d7ac-4618-9dc8-5629d65acc9a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:11.993169 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3681fa66-d7ac-4618-9dc8-5629d65acc9a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:11.993939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3681fa66-d7ac-4618-9dc8-5629d65acc9a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:11.994365 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3681fa66-d7ac-4618-9dc8-5629d65acc9a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:12.087257 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-09eb6387-6065-4c33-8d75-0950259c0777 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:12.087860 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-09eb6387-6065-4c33-8d75-0950259c0777 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:12.095539 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-09eb6387-6065-4c33-8d75-0950259c0777 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:12.096010 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-09eb6387-6065-4c33-8d75-0950259c0777 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:12.097007 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-09eb6387-6065-4c33-8d75-0950259c0777 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:12.097607 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-09eb6387-6065-4c33-8d75-0950259c0777 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:12.148683 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3681fa66-d7ac-4618-9dc8-5629d65acc9a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:12.157034 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3681fa66-d7ac-4618-9dc8-5629d65acc9a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1259 microversion: 2.1 time: 0.175793 Jun 06 21:08:12.157887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 210/414] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:11 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:12.242248 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-09eb6387-6065-4c33-8d75-0950259c0777 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:12.250183 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-09eb6387-6065-4c33-8d75-0950259c0777 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1683 microversion: 2.1 time: 0.166932 Jun 06 21:08:12.250762 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 205/415] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:12 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:12.575367 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-59767931-7866-497e-b56f-e52e2d418637 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:12.576017 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-59767931-7866-497e-b56f-e52e2d418637 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:12.582916 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-8c5b64cc-b886-48c2-a6d7-1d37be54d16c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:12.583123 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59767931-7866-497e-b56f-e52e2d418637 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:12.583452 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59767931-7866-497e-b56f-e52e2d418637 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:12.583632 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-8c5b64cc-b886-48c2-a6d7-1d37be54d16c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:12.584238 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59767931-7866-497e-b56f-e52e2d418637 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:12.584664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-59767931-7866-497e-b56f-e52e2d418637 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:12.590969 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8c5b64cc-b886-48c2-a6d7-1d37be54d16c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:12.591415 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8c5b64cc-b886-48c2-a6d7-1d37be54d16c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:12.592212 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8c5b64cc-b886-48c2-a6d7-1d37be54d16c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:12.592635 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8c5b64cc-b886-48c2-a6d7-1d37be54d16c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:12.718509 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-59767931-7866-497e-b56f-e52e2d418637 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:12.722164 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-8c5b64cc-b886-48c2-a6d7-1d37be54d16c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:12.726169 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-59767931-7866-497e-b56f-e52e2d418637 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1318 microversion: 2.1 time: 0.155049 Jun 06 21:08:12.726740 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 211/416] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:12 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:12.729739 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-8c5b64cc-b886-48c2-a6d7-1d37be54d16c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.150674 Jun 06 21:08:12.730300 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 206/417] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:12 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:12.915195 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8c3b60b9-01d8-427a-9c31-1f5c863c0ab0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:12.915707 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8c3b60b9-01d8-427a-9c31-1f5c863c0ab0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:12.922800 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8c3b60b9-01d8-427a-9c31-1f5c863c0ab0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:12.923245 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8c3b60b9-01d8-427a-9c31-1f5c863c0ab0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:12.924021 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8c3b60b9-01d8-427a-9c31-1f5c863c0ab0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:12.924472 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8c3b60b9-01d8-427a-9c31-1f5c863c0ab0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:13.080175 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8c3b60b9-01d8-427a-9c31-1f5c863c0ab0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:13.093214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8c3b60b9-01d8-427a-9c31-1f5c863c0ab0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:13.095273 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8c3b60b9-01d8-427a-9c31-1f5c863c0ab0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:13.096628 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8c3b60b9-01d8-427a-9c31-1f5c863c0ab0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.185475 Jun 06 21:08:13.097340 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 212/418] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:08:12 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:08:13.176760 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-7b178981-9d4f-4e9f-88ef-5819ad2a8b07 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:13.177613 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-7b178981-9d4f-4e9f-88ef-5819ad2a8b07 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:13.184268 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7b178981-9d4f-4e9f-88ef-5819ad2a8b07 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:13.184703 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7b178981-9d4f-4e9f-88ef-5819ad2a8b07 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:13.185463 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7b178981-9d4f-4e9f-88ef-5819ad2a8b07 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:13.185882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7b178981-9d4f-4e9f-88ef-5819ad2a8b07 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:13.269824 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-eba5401f-8d8d-49fa-9623-224704653798 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:13.270433 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-eba5401f-8d8d-49fa-9623-224704653798 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:13.277153 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eba5401f-8d8d-49fa-9623-224704653798 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:13.277733 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eba5401f-8d8d-49fa-9623-224704653798 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:13.278657 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eba5401f-8d8d-49fa-9623-224704653798 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:13.279086 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eba5401f-8d8d-49fa-9623-224704653798 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:13.357381 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-7b178981-9d4f-4e9f-88ef-5819ad2a8b07 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:13.365830 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-7b178981-9d4f-4e9f-88ef-5819ad2a8b07 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1259 microversion: 2.1 time: 0.194405 Jun 06 21:08:13.366418 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 207/419] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:13 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:13.451368 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-eba5401f-8d8d-49fa-9623-224704653798 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:13.460411 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-eba5401f-8d8d-49fa-9623-224704653798 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1683 microversion: 2.1 time: 0.194346 Jun 06 21:08:13.460997 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 213/420] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:13 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1683 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:13.743709 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-c04ebedd-6a76-4918-aa15-d1856a73b3e8 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:13.744418 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-c04ebedd-6a76-4918-aa15-d1856a73b3e8 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:13.746475 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=2 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:13.746961 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-140b4b0e-b7ae-4a67-9704-1f8681ba4c03 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:13.747807 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-140b4b0e-b7ae-4a67-9704-1f8681ba4c03 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:13.753670 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c04ebedd-6a76-4918-aa15-d1856a73b3e8 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:13.754155 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c04ebedd-6a76-4918-aa15-d1856a73b3e8 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:13.754695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-140b4b0e-b7ae-4a67-9704-1f8681ba4c03 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:13.755016 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c04ebedd-6a76-4918-aa15-d1856a73b3e8 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:13.755236 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-140b4b0e-b7ae-4a67-9704-1f8681ba4c03 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:13.755564 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c04ebedd-6a76-4918-aa15-d1856a73b3e8 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:13.756064 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-140b4b0e-b7ae-4a67-9704-1f8681ba4c03 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:13.756500 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-140b4b0e-b7ae-4a67-9704-1f8681ba4c03 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:13.910793 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c04ebedd-6a76-4918-aa15-d1856a73b3e8 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:13.916520 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-140b4b0e-b7ae-4a67-9704-1f8681ba4c03 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:13.918896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-c04ebedd-6a76-4918-aa15-d1856a73b3e8 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1318 microversion: 2.1 time: 0.179349 Jun 06 21:08:13.919494 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 208/421] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:13 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:13.926019 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-140b4b0e-b7ae-4a67-9704-1f8681ba4c03 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.183213 Jun 06 21:08:13.926616 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 214/422] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:13 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:14.121173 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-103f6c35-8b87-472c-adde-dcf7e3ff4ad1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:14.121998 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-103f6c35-8b87-472c-adde-dcf7e3ff4ad1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:14.128369 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-103f6c35-8b87-472c-adde-dcf7e3ff4ad1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:14.128798 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-103f6c35-8b87-472c-adde-dcf7e3ff4ad1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:14.129559 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-103f6c35-8b87-472c-adde-dcf7e3ff4ad1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:14.129981 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-103f6c35-8b87-472c-adde-dcf7e3ff4ad1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:14.282274 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-103f6c35-8b87-472c-adde-dcf7e3ff4ad1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:14.293083 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-103f6c35-8b87-472c-adde-dcf7e3ff4ad1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:14.294589 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-103f6c35-8b87-472c-adde-dcf7e3ff4ad1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:14.295758 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-103f6c35-8b87-472c-adde-dcf7e3ff4ad1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.180588 Jun 06 21:08:14.296333 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 209/423] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:08:14 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:08:14.385094 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-61c342ef-7346-4f33-bf80-30a12cf41e0d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:14.385887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-61c342ef-7346-4f33-bf80-30a12cf41e0d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:14.389201 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=4 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:14.390177 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=14 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:14.399328 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61c342ef-7346-4f33-bf80-30a12cf41e0d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:14.400129 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61c342ef-7346-4f33-bf80-30a12cf41e0d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:14.401232 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61c342ef-7346-4f33-bf80-30a12cf41e0d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:14.401804 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61c342ef-7346-4f33-bf80-30a12cf41e0d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:14.478825 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-c35e2096-2f41-4dfe-9582-53c949251a19 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:14.479431 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-c35e2096-2f41-4dfe-9582-53c949251a19 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:14.485833 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c35e2096-2f41-4dfe-9582-53c949251a19 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:14.486355 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c35e2096-2f41-4dfe-9582-53c949251a19 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:14.487041 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c35e2096-2f41-4dfe-9582-53c949251a19 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:14.487471 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c35e2096-2f41-4dfe-9582-53c949251a19 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:14.542906 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-61c342ef-7346-4f33-bf80-30a12cf41e0d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:14.545525 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:14.552599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-61c342ef-7346-4f33-bf80-30a12cf41e0d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1259 microversion: 2.1 time: 0.173188 Jun 06 21:08:14.553133 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 215/424] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:14 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:14.620780 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c35e2096-2f41-4dfe-9582-53c949251a19 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:14.629924 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-c35e2096-2f41-4dfe-9582-53c949251a19 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1683 microversion: 2.1 time: 0.154857 Jun 06 21:08:14.630586 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 210/425] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:14 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:14.943103 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2a3f2d7e-7840-4c83-bb6b-3c6f36aa4d9b tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:14.944087 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2a3f2d7e-7840-4c83-bb6b-3c6f36aa4d9b tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:14.946636 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-bf323bec-73d0-4bee-bf73-d2a7564c7623 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:14.947624 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-bf323bec-73d0-4bee-bf73-d2a7564c7623 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:14.956027 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a3f2d7e-7840-4c83-bb6b-3c6f36aa4d9b tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:14.956790 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a3f2d7e-7840-4c83-bb6b-3c6f36aa4d9b tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:14.958056 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a3f2d7e-7840-4c83-bb6b-3c6f36aa4d9b tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:14.958744 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a3f2d7e-7840-4c83-bb6b-3c6f36aa4d9b tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:14.959230 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bf323bec-73d0-4bee-bf73-d2a7564c7623 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:14.959905 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bf323bec-73d0-4bee-bf73-d2a7564c7623 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:14.961466 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bf323bec-73d0-4bee-bf73-d2a7564c7623 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:14.962407 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bf323bec-73d0-4bee-bf73-d2a7564c7623 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:15.129120 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2a3f2d7e-7840-4c83-bb6b-3c6f36aa4d9b tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:15.132784 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-bf323bec-73d0-4bee-bf73-d2a7564c7623 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:15.137919 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2a3f2d7e-7840-4c83-bb6b-3c6f36aa4d9b tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1318 microversion: 2.1 time: 0.200891 Jun 06 21:08:15.138708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 216/426] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:14 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:15.140751 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-bf323bec-73d0-4bee-bf73-d2a7564c7623 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.200659 Jun 06 21:08:15.141337 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 211/427] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:14 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:15.314186 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6a28a94f-bc77-4720-940d-ce93ce77fcf1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:15.314764 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6a28a94f-bc77-4720-940d-ce93ce77fcf1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:15.321453 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6a28a94f-bc77-4720-940d-ce93ce77fcf1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:15.321897 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6a28a94f-bc77-4720-940d-ce93ce77fcf1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:15.322659 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6a28a94f-bc77-4720-940d-ce93ce77fcf1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:15.323078 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6a28a94f-bc77-4720-940d-ce93ce77fcf1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:15.464966 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6a28a94f-bc77-4720-940d-ce93ce77fcf1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:15.473901 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6a28a94f-bc77-4720-940d-ce93ce77fcf1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:15.475373 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6a28a94f-bc77-4720-940d-ce93ce77fcf1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:15.476578 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6a28a94f-bc77-4720-940d-ce93ce77fcf1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.166338 Jun 06 21:08:15.477325 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 217/428] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:08:15 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:08:15.572022 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0ef200f0-1f13-4c12-8106-f69fe846b6aa tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:15.572660 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-0ef200f0-1f13-4c12-8106-f69fe846b6aa tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:15.579571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0ef200f0-1f13-4c12-8106-f69fe846b6aa tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:15.580018 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0ef200f0-1f13-4c12-8106-f69fe846b6aa tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:15.580776 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0ef200f0-1f13-4c12-8106-f69fe846b6aa tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:15.581198 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0ef200f0-1f13-4c12-8106-f69fe846b6aa tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:15.649675 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-aa2522db-aff2-4881-acc1-803d017deb9c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:15.650352 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-aa2522db-aff2-4881-acc1-803d017deb9c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:15.658014 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aa2522db-aff2-4881-acc1-803d017deb9c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:15.658317 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aa2522db-aff2-4881-acc1-803d017deb9c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:15.659132 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aa2522db-aff2-4881-acc1-803d017deb9c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:15.659562 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aa2522db-aff2-4881-acc1-803d017deb9c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:15.733008 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-0ef200f0-1f13-4c12-8106-f69fe846b6aa tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:15.741160 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-0ef200f0-1f13-4c12-8106-f69fe846b6aa tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1259 microversion: 2.1 time: 0.174780 Jun 06 21:08:15.741743 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 212/429] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:15 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:15.819089 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-aa2522db-aff2-4881-acc1-803d017deb9c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:15.829155 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-aa2522db-aff2-4881-acc1-803d017deb9c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1683 microversion: 2.1 time: 0.185035 Jun 06 21:08:15.830086 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 218/430] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:15 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1683 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:16.155662 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-53164750-c3f3-4dd4-a362-083ca85f9258 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:16.156311 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-53164750-c3f3-4dd4-a362-083ca85f9258 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:16.158747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fd5fc9f6-db7f-4d87-ac9f-fd6df7eee66e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:16.159431 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fd5fc9f6-db7f-4d87-ac9f-fd6df7eee66e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:16.163662 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-53164750-c3f3-4dd4-a362-083ca85f9258 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:16.164290 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-53164750-c3f3-4dd4-a362-083ca85f9258 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:16.165146 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-53164750-c3f3-4dd4-a362-083ca85f9258 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:16.165564 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-53164750-c3f3-4dd4-a362-083ca85f9258 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:16.166106 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fd5fc9f6-db7f-4d87-ac9f-fd6df7eee66e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:16.166564 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fd5fc9f6-db7f-4d87-ac9f-fd6df7eee66e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:16.167337 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fd5fc9f6-db7f-4d87-ac9f-fd6df7eee66e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:16.167771 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fd5fc9f6-db7f-4d87-ac9f-fd6df7eee66e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:16.315510 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-53164750-c3f3-4dd4-a362-083ca85f9258 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:16.318519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fd5fc9f6-db7f-4d87-ac9f-fd6df7eee66e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:16.325632 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-53164750-c3f3-4dd4-a362-083ca85f9258 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1318 microversion: 2.1 time: 0.174150 Jun 06 21:08:16.326228 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 213/431] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:16 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:16.326524 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fd5fc9f6-db7f-4d87-ac9f-fd6df7eee66e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.171789 Jun 06 21:08:16.327186 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 219/432] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:16 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:08:16.499147 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-36a7cd7e-6ae8-4929-8110-69db9be36418 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:16.500248 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-36a7cd7e-6ae8-4929-8110-69db9be36418 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:16.512317 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-36a7cd7e-6ae8-4929-8110-69db9be36418 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:16.513112 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-36a7cd7e-6ae8-4929-8110-69db9be36418 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:16.514495 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-36a7cd7e-6ae8-4929-8110-69db9be36418 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:16.515237 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-36a7cd7e-6ae8-4929-8110-69db9be36418 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:16.681005 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-36a7cd7e-6ae8-4929-8110-69db9be36418 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:16.690143 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-36a7cd7e-6ae8-4929-8110-69db9be36418 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:16.691654 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-36a7cd7e-6ae8-4929-8110-69db9be36418 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:16.693603 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-36a7cd7e-6ae8-4929-8110-69db9be36418 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.200119 Jun 06 21:08:16.693603 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 214/433] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:08:16 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:08:16.758694 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6d45c253-6926-4265-b371-bdcdc3dffffc tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:16.759421 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6d45c253-6926-4265-b371-bdcdc3dffffc tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:16.767010 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d45c253-6926-4265-b371-bdcdc3dffffc tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:16.767457 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d45c253-6926-4265-b371-bdcdc3dffffc tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:16.768268 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d45c253-6926-4265-b371-bdcdc3dffffc tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:16.768697 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d45c253-6926-4265-b371-bdcdc3dffffc tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:16.847919 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-f9d29feb-03f5-42f2-baf8-ba979da64d85 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:16.848463 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-f9d29feb-03f5-42f2-baf8-ba979da64d85 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:16.855059 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f9d29feb-03f5-42f2-baf8-ba979da64d85 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:16.855477 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f9d29feb-03f5-42f2-baf8-ba979da64d85 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:16.857179 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f9d29feb-03f5-42f2-baf8-ba979da64d85 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:16.857623 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f9d29feb-03f5-42f2-baf8-ba979da64d85 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:16.930852 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6d45c253-6926-4265-b371-bdcdc3dffffc tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:16.944893 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6d45c253-6926-4265-b371-bdcdc3dffffc tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1259 microversion: 2.1 time: 0.189756 Jun 06 21:08:16.945830 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 220/434] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:16 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:17.023453 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-f9d29feb-03f5-42f2-baf8-ba979da64d85 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:17.035577 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-f9d29feb-03f5-42f2-baf8-ba979da64d85 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1683 microversion: 2.1 time: 0.191547 Jun 06 21:08:17.036346 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 215/435] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:16 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1683 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:17.343535 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2f4a84e5-8beb-4a3f-a70c-6ac34955d6ea tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:17.344181 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2f4a84e5-8beb-4a3f-a70c-6ac34955d6ea tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:17.350854 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-33618e03-9f3c-445a-b8b1-b7b00e3a893e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:17.351062 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2f4a84e5-8beb-4a3f-a70c-6ac34955d6ea tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:17.351292 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2f4a84e5-8beb-4a3f-a70c-6ac34955d6ea tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:17.351458 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-33618e03-9f3c-445a-b8b1-b7b00e3a893e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:17.352078 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2f4a84e5-8beb-4a3f-a70c-6ac34955d6ea tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:17.352506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2f4a84e5-8beb-4a3f-a70c-6ac34955d6ea tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:17.358548 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-33618e03-9f3c-445a-b8b1-b7b00e3a893e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:17.359001 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-33618e03-9f3c-445a-b8b1-b7b00e3a893e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:17.359788 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-33618e03-9f3c-445a-b8b1-b7b00e3a893e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:17.360260 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-33618e03-9f3c-445a-b8b1-b7b00e3a893e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:17.499360 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2f4a84e5-8beb-4a3f-a70c-6ac34955d6ea tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:17.507437 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2f4a84e5-8beb-4a3f-a70c-6ac34955d6ea tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1318 microversion: 2.1 time: 0.167844 Jun 06 21:08:17.508033 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 221/436] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:17 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:17.712565 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-dcf49800-1b1a-4bdd-a172-36ebcd685cbe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:17.713202 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-dcf49800-1b1a-4bdd-a172-36ebcd685cbe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:17.720537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dcf49800-1b1a-4bdd-a172-36ebcd685cbe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:17.720993 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dcf49800-1b1a-4bdd-a172-36ebcd685cbe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:17.721825 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dcf49800-1b1a-4bdd-a172-36ebcd685cbe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:17.722257 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dcf49800-1b1a-4bdd-a172-36ebcd685cbe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:17.751878 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-33618e03-9f3c-445a-b8b1-b7b00e3a893e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:17.759908 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-33618e03-9f3c-445a-b8b1-b7b00e3a893e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.412897 Jun 06 21:08:17.760551 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 216/437] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:17 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:17.863255 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-dcf49800-1b1a-4bdd-a172-36ebcd685cbe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:17.872005 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-dcf49800-1b1a-4bdd-a172-36ebcd685cbe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:17.873573 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-dcf49800-1b1a-4bdd-a172-36ebcd685cbe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:17.874716 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-dcf49800-1b1a-4bdd-a172-36ebcd685cbe tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.166154 Jun 06 21:08:17.875281 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 222/438] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:08:17 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:08:17.973412 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-4259713c-33aa-46bc-9342-e43828019925 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:17.973898 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-4259713c-33aa-46bc-9342-e43828019925 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:17.980620 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4259713c-33aa-46bc-9342-e43828019925 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:17.981078 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4259713c-33aa-46bc-9342-e43828019925 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:17.981835 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4259713c-33aa-46bc-9342-e43828019925 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:17.982275 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4259713c-33aa-46bc-9342-e43828019925 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:18.054696 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-731ce09f-e6f7-4079-82a2-ed834a169ca2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:18.055434 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-731ce09f-e6f7-4079-82a2-ed834a169ca2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:18.062838 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-731ce09f-e6f7-4079-82a2-ed834a169ca2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:18.063376 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-731ce09f-e6f7-4079-82a2-ed834a169ca2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:18.064258 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-731ce09f-e6f7-4079-82a2-ed834a169ca2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:18.064869 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-731ce09f-e6f7-4079-82a2-ed834a169ca2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:18.122082 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-4259713c-33aa-46bc-9342-e43828019925 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:18.131105 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-4259713c-33aa-46bc-9342-e43828019925 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1259 microversion: 2.1 time: 0.163110 Jun 06 21:08:18.131687 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 217/439] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:17 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:18.202172 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-731ce09f-e6f7-4079-82a2-ed834a169ca2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:18.213177 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-731ce09f-e6f7-4079-82a2-ed834a169ca2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1683 microversion: 2.1 time: 0.162319 Jun 06 21:08:18.213984 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 223/440] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:18 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:18.525648 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0f725611-1f61-4b7e-b482-bd54177ab919 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:18.526248 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-0f725611-1f61-4b7e-b482-bd54177ab919 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:18.533235 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0f725611-1f61-4b7e-b482-bd54177ab919 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:18.533673 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0f725611-1f61-4b7e-b482-bd54177ab919 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:18.534423 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0f725611-1f61-4b7e-b482-bd54177ab919 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:18.534841 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0f725611-1f61-4b7e-b482-bd54177ab919 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:18.777514 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9cd509ab-c3ae-4b86-bc34-c4abd680b386 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:18.779092 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9cd509ab-c3ae-4b86-bc34-c4abd680b386 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:18.786161 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9cd509ab-c3ae-4b86-bc34-c4abd680b386 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:18.786647 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9cd509ab-c3ae-4b86-bc34-c4abd680b386 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:18.787744 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9cd509ab-c3ae-4b86-bc34-c4abd680b386 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:18.788293 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9cd509ab-c3ae-4b86-bc34-c4abd680b386 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:18.813113 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-0f725611-1f61-4b7e-b482-bd54177ab919 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:18.815705 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=100 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:18.826223 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-0f725611-1f61-4b7e-b482-bd54177ab919 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1318 microversion: 2.1 time: 0.304494 Jun 06 21:08:18.838039 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 218/441] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:18 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:18.894570 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-ab9deafb-3a03-45fd-a6c6-5e3a123ca108 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:18.895191 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-ab9deafb-3a03-45fd-a6c6-5e3a123ca108 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:18.902394 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ab9deafb-3a03-45fd-a6c6-5e3a123ca108 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:18.902986 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ab9deafb-3a03-45fd-a6c6-5e3a123ca108 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:18.904621 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ab9deafb-3a03-45fd-a6c6-5e3a123ca108 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:18.905247 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ab9deafb-3a03-45fd-a6c6-5e3a123ca108 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:18.942456 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9cd509ab-c3ae-4b86-bc34-c4abd680b386 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:18.951189 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9cd509ab-c3ae-4b86-bc34-c4abd680b386 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.177878 Jun 06 21:08:18.952420 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 224/442] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:18 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:08:19.098095 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-ab9deafb-3a03-45fd-a6c6-5e3a123ca108 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:19.108521 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-ab9deafb-3a03-45fd-a6c6-5e3a123ca108 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:19.110039 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-ab9deafb-3a03-45fd-a6c6-5e3a123ca108 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:19.111218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-ab9deafb-3a03-45fd-a6c6-5e3a123ca108 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.221556 Jun 06 21:08:19.111789 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 219/443] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:08:18 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:08:19.150500 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-556dc18e-04a5-4b2b-92bd-2df8150f101d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:19.155921 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-556dc18e-04a5-4b2b-92bd-2df8150f101d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:19.165030 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-556dc18e-04a5-4b2b-92bd-2df8150f101d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:19.165030 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-556dc18e-04a5-4b2b-92bd-2df8150f101d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:19.165030 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-556dc18e-04a5-4b2b-92bd-2df8150f101d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:19.165030 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-556dc18e-04a5-4b2b-92bd-2df8150f101d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:19.230837 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-ddbe1edd-e73e-4f1a-a10d-13c5083a8ae8 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:19.231488 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-ddbe1edd-e73e-4f1a-a10d-13c5083a8ae8 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:19.238693 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ddbe1edd-e73e-4f1a-a10d-13c5083a8ae8 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:19.239134 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ddbe1edd-e73e-4f1a-a10d-13c5083a8ae8 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:19.239893 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ddbe1edd-e73e-4f1a-a10d-13c5083a8ae8 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:19.240355 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ddbe1edd-e73e-4f1a-a10d-13c5083a8ae8 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:19.328680 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-ddbe1edd-e73e-4f1a-a10d-13c5083a8ae8 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:19.337041 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-ddbe1edd-e73e-4f1a-a10d-13c5083a8ae8 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 200 len: 1615 microversion: 2.1 time: 0.110030 Jun 06 21:08:19.338023 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 220/444] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:19 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 1615 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:08:19.346157 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-556dc18e-04a5-4b2b-92bd-2df8150f101d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:19.354187 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-556dc18e-04a5-4b2b-92bd-2df8150f101d tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1259 microversion: 2.1 time: 0.209090 Jun 06 21:08:19.355044 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 225/445] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:19 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1259 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:19.514917 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-7ca96632-a889-4af2-b959-69a21c27cd77 req-9ff94b2d-c241-4a23-ad4d-b7c4e6f9c8d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a6a1d28-5f70-418f-8991-139855579e13", "name": "network-vif-deleted", "tag": "20de69b0-9510-4128-a2cf-7b94f568ad57"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:19.523086 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-7ca96632-a889-4af2-b959-69a21c27cd77 req-9ff94b2d-c241-4a23-ad4d-b7c4e6f9c8d7 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:19.523522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-7ca96632-a889-4af2-b959-69a21c27cd77 req-9ff94b2d-c241-4a23-ad4d-b7c4e6f9c8d7 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:19.537224 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-7ca96632-a889-4af2-b959-69a21c27cd77 req-9ff94b2d-c241-4a23-ad4d-b7c4e6f9c8d7 service nova] Creating event network-vif-deleted:20de69b0-9510-4128-a2cf-7b94f568ad57 for instance 8a6a1d28-5f70-418f-8991-139855579e13 on hv-cinder-84488 Jun 06 21:08:19.543677 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-7ca96632-a889-4af2-b959-69a21c27cd77 req-9ff94b2d-c241-4a23-ad4d-b7c4e6f9c8d7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032501 Jun 06 21:08:19.547566 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 221/446] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:08:19.845287 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ce555b67-7f6e-4200-8761-6b3ae0174ba1 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:19.845851 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ce555b67-7f6e-4200-8761-6b3ae0174ba1 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:19.852698 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce555b67-7f6e-4200-8761-6b3ae0174ba1 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:19.853271 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce555b67-7f6e-4200-8761-6b3ae0174ba1 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:19.853906 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce555b67-7f6e-4200-8761-6b3ae0174ba1 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:19.854796 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ce555b67-7f6e-4200-8761-6b3ae0174ba1 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:19.974746 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-32e875bc-1033-42be-882a-a3e6365eacd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:19.977242 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-32e875bc-1033-42be-882a-a3e6365eacd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:19.989018 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-32e875bc-1033-42be-882a-a3e6365eacd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:19.990464 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-32e875bc-1033-42be-882a-a3e6365eacd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:19.992129 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-32e875bc-1033-42be-882a-a3e6365eacd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:19.993257 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-32e875bc-1033-42be-882a-a3e6365eacd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:20.011465 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ce555b67-7f6e-4200-8761-6b3ae0174ba1 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:20.020321 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ce555b67-7f6e-4200-8761-6b3ae0174ba1 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1318 microversion: 2.1 time: 0.179790 Jun 06 21:08:20.030048 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 226/447] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:19 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:20.130069 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-71646456-306f-4726-96b9-22f47ee1df3b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:20.130885 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-71646456-306f-4726-96b9-22f47ee1df3b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:20.139467 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-71646456-306f-4726-96b9-22f47ee1df3b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:20.140260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-71646456-306f-4726-96b9-22f47ee1df3b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:20.141322 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-71646456-306f-4726-96b9-22f47ee1df3b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:20.141927 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-71646456-306f-4726-96b9-22f47ee1df3b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:20.177545 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-32e875bc-1033-42be-882a-a3e6365eacd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:20.192597 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-32e875bc-1033-42be-882a-a3e6365eacd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1500 microversion: 2.1 time: 0.222626 Jun 06 21:08:20.202543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 222/448] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:19 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1500 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:20.211946 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-3641b9c3-0aa8-4491-a13b-74f2819c426a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb6547a3-07a8-4d71-9f2d-5164f3b5af73"}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:20.214279 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-3641b9c3-0aa8-4491-a13b-74f2819c426a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:20.226803 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3641b9c3-0aa8-4491-a13b-74f2819c426a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:20.228081 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3641b9c3-0aa8-4491-a13b-74f2819c426a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:20.229755 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3641b9c3-0aa8-4491-a13b-74f2819c426a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:20.231747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3641b9c3-0aa8-4491-a13b-74f2819c426a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:20.271961 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-3641b9c3-0aa8-4491-a13b-74f2819c426a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] HTTP exception thrown: Cannot 'attach_volume' instance 9258ebef-e9e5-47b9-84b9-d02803d028b1 while it is in vm_state rescued Jun 06 21:08:20.275706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-3641b9c3-0aa8-4491-a13b-74f2819c426a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Request method failure captured: Jun 06 21:08:20.275706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: POST /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1/os-volume_attachments HTTP/1.1 Jun 06 21:08:20.275706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:08:20.275706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:08:20.275706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:08:20.275706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 74 Jun 06 21:08:20.275706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:08:20.275706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:08:20.275706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:08:20.275706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:08:20.275706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinmw5kgLR6NMd10ofnxehsGJrZH5eihmOg4VV2rlqBjZwvfhUx8kow_T1NaOr6zNm6K1jJsuYEhS0J5QDngP2LhFXAmzwJ6InRv6t8Nhyq76ejvBrCHdAnd0U1eHtmfrOhv9AMEP1mJ0K9M-NNm9AUbkBVRKPRAi4NyD11SlCUna2Q5g Jun 06 21:08:20.275706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:08:20.275706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:08:20.275706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:08:20.275706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:08:20.275706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:08:20.275706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:08:20.275706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: f0246519bc2240cf8d1ba54172c0faca Jun 06 21:08:20.275706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-615855304 Jun 06 21:08:20.275706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:08:20.275706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:08:20.278629 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0246519bc2240cf8d1ba54172c0faca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f0246519bc2240cf8d1ba54172c0faca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f0246519bc2240cf8d1ba54172c0faca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0246519bc2240cf8d1ba54172c0faca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:08:20.278629 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-ServerRescueNegativeTestJSON-615855304 Jun 06 21:08:20.278629 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: f0246519bc2240cf8d1ba54172c0faca Jun 06 21:08:20.278629 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-615855304 Jun 06 21:08:20.278629 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-ServerRescueNegativeTestJSON-615855304-project Jun 06 21:08:20.278629 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:08:20.278629 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:08:20.278629 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: ab9da673f40b4e3eb541fdc380cfe282 Jun 06 21:08:20.278629 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-ServerRescueNegativeTestJSON-615855304-project Jun 06 21:08:20.278629 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Jun 06 21:08:20.278629 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {"volumeAttachment": {"volumeId": "cb6547a3-07a8-4d71-9f2d-5164f3b5af73"}} Jun 06 21:08:20.278629 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: > Jun 06 21:08:20.280263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Cannot 'attach_volume' instance 9258ebef-e9e5-47b9-84b9-d02803d028b1 while it is in vm_state rescued Jun 06 21:08:20.280263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'server_id': '9258ebef-e9e5-47b9-84b9-d02803d028b1', 'body': {'volumeAttachment': {'volumeId': 'cb6547a3-07a8-4d71-9f2d-5164f3b5af73'}}} Jun 06 21:08:20.280263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:08:20.280263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:08:20.280263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 06 21:08:20.280263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 06 21:08:20.280263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 21:08:20.280263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 21:08:20.280263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 06 21:08:20.280263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 06 21:08:20.280263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9258ebef-e9e5-47b9-84b9-d02803d028b1 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 06 21:08:20.280263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:08:20.280263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:08:20.280263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:08:20.280263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:08:20.280263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:08:20.280263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:08:20.280263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:08:20.280263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:08:20.283396 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:08:20.283396 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:08:20.283396 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 21:08:20.283396 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 21:08:20.283396 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 21:08:20.283396 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 21:08:20.283396 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 21:08:20.283396 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 21:08:20.283396 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 06 21:08:20.283396 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 06 21:08:20.283396 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 06 21:08:20.283396 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 06 21:08:20.283396 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9258ebef-e9e5-47b9-84b9-d02803d028b1 while it is in vm_state rescued Jun 06 21:08:20.283396 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:08:20.283396 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:08:20.283396 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:08:20.283396 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:08:20.283396 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:08:20.283396 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:08:20.288455 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:08:20.288455 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:08:20.288455 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9258ebef-e9e5-47b9-84b9-d02803d028b1 while it is in vm_state rescued Jun 06 21:08:20.288455 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:08:20.288455 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-3641b9c3-0aa8-4491-a13b-74f2819c426a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Returning 409 to user: Cannot 'attach_volume' instance 9258ebef-e9e5-47b9-84b9-d02803d028b1 while it is in vm_state rescued {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:08:20.289656 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-3641b9c3-0aa8-4491-a13b-74f2819c426a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "POST /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.083248 Jun 06 21:08:20.290796 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 223/449] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 6 21:08:20 2022] POST /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1/os-volume_attachments => generated 152 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 06 21:08:20.304466 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-f7e39d74-03f7-46f8-9ab3-b9f2c831f1d6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:20.312085 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-f7e39d74-03f7-46f8-9ab3-b9f2c831f1d6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:20.323954 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f7e39d74-03f7-46f8-9ab3-b9f2c831f1d6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:20.330964 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f7e39d74-03f7-46f8-9ab3-b9f2c831f1d6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:20.332463 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f7e39d74-03f7-46f8-9ab3-b9f2c831f1d6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:20.333114 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f7e39d74-03f7-46f8-9ab3-b9f2c831f1d6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:20.397358 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-71646456-306f-4726-96b9-22f47ee1df3b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:20.412277 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-71646456-306f-4726-96b9-22f47ee1df3b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:20.414323 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-71646456-306f-4726-96b9-22f47ee1df3b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:20.415859 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-71646456-306f-4726-96b9-22f47ee1df3b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.289695 Jun 06 21:08:20.416866 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 227/450] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:08:20 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:08:20.423843 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-818373f5-73a9-4448-8d4e-b6ff1d5120bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:20.425010 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-818373f5-73a9-4448-8d4e-b6ff1d5120bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:20.435442 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-818373f5-73a9-4448-8d4e-b6ff1d5120bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:20.436165 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-818373f5-73a9-4448-8d4e-b6ff1d5120bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:20.437188 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-818373f5-73a9-4448-8d4e-b6ff1d5120bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:20.437709 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-818373f5-73a9-4448-8d4e-b6ff1d5120bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:20.468417 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-818373f5-73a9-4448-8d4e-b6ff1d5120bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] HTTP exception thrown: Instance 8a6a1d28-5f70-418f-8991-139855579e13 could not be found. Jun 06 21:08:20.470349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-818373f5-73a9-4448-8d4e-b6ff1d5120bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Request method failure captured: Jun 06 21:08:20.470349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 HTTP/1.1 Jun 06 21:08:20.470349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:08:20.470349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:08:20.470349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:08:20.470349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:08:20.470349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:08:20.470349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:08:20.470349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:08:20.470349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:08:20.470349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinmvxW1bVEWZVhCRlgeG6PDmaOvHpznA6mf68h7fAFngISNh4GnD9XFqvo52ymtA4PTaTSN-lCxDTYk7dFVIPU5elkSuX6Hf8rm-_SR1iR7N3wUEkc6KR6wmwlcMFMA3l3v8mmff7I1soQTiyS_qgppqz32gWX7gOKmiYav_WF1YU4TA Jun 06 21:08:20.470349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:08:20.470349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:08:20.470349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:08:20.470349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:08:20.470349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:08:20.470349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:08:20.470349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:08:20.470349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:08:20.470349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:08:20.470349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:08:20.472078 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:08:20.472078 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:08:20.472078 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:08:20.472078 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:08:20.472078 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:08:20.472078 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:08:20.472078 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:08:20.472078 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: 8713cb23a93147f8b52f88e240c81d6f Jun 06 21:08:20.472078 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:08:20.472078 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: > Jun 06 21:08:20.472078 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Instance 8a6a1d28-5f70-418f-8991-139855579e13 could not be found. Jun 06 21:08:20.472078 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '8a6a1d28-5f70-418f-8991-139855579e13'} Jun 06 21:08:20.473381 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:08:20.473381 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:08:20.473381 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:08:20.473381 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:08:20.473381 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:08:20.473381 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:08:20.473381 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:08:20.473381 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:08:20.473381 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:08:20.473381 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:08:20.473381 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a6a1d28-5f70-418f-8991-139855579e13 could not be found. Jun 06 21:08:20.473381 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:08:20.473381 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:08:20.473381 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:08:20.473381 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:08:20.473381 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:08:20.473381 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:08:20.473381 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:08:20.473381 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:08:20.473381 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:08:20.474538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:08:20.474538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:08:20.474538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:08:20.474538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:08:20.474538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:08:20.474538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:08:20.474538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:08:20.474538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a6a1d28-5f70-418f-8991-139855579e13 could not be found. Jun 06 21:08:20.474538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:08:20.474538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:08:20.474538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:08:20.474538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:08:20.474538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:08:20.474538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:08:20.474538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:08:20.474538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:08:20.474538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a6a1d28-5f70-418f-8991-139855579e13 could not be found. Jun 06 21:08:20.474538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:08:20.481243 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-818373f5-73a9-4448-8d4e-b6ff1d5120bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Returning 404 to user: Instance 8a6a1d28-5f70-418f-8991-139855579e13 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:08:20.483224 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-f7e39d74-03f7-46f8-9ab3-b9f2c831f1d6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "POST /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1/action" status: 202 len: 0 microversion: 2.1 time: 0.183743 Jun 06 21:08:20.485405 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 224/451] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 6 21:08:20 2022] POST /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:08:20.487934 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-818373f5-73a9-4448-8d4e-b6ff1d5120bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 404 len: 111 microversion: 2.1 time: 0.067389 Jun 06 21:08:20.490131 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 228/452] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:20 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:08:20.501217 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-586fd54b-7e17-4516-9944-c0268f81adc4 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:20.502242 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-99a45899-93e9-4d7f-87be-47f23362141f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:20.503010 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-99a45899-93e9-4d7f-87be-47f23362141f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:20.503442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-586fd54b-7e17-4516-9944-c0268f81adc4 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:20.514147 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-99a45899-93e9-4d7f-87be-47f23362141f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:20.514898 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-99a45899-93e9-4d7f-87be-47f23362141f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:20.515887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-99a45899-93e9-4d7f-87be-47f23362141f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:20.516499 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-99a45899-93e9-4d7f-87be-47f23362141f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:20.521660 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-586fd54b-7e17-4516-9944-c0268f81adc4 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:20.522119 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-586fd54b-7e17-4516-9944-c0268f81adc4 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:20.534204 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-586fd54b-7e17-4516-9944-c0268f81adc4 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:20.535524 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-586fd54b-7e17-4516-9944-c0268f81adc4 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:20.749064 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-99a45899-93e9-4d7f-87be-47f23362141f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:20.778091 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-99a45899-93e9-4d7f-87be-47f23362141f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1508 microversion: 2.1 time: 0.283189 Jun 06 21:08:20.779660 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 229/453] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:20 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1508 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:20.785488 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6fcbca5b-e633-4648-ad6a-f97bb711cb53 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '.version_select at 0x7f27257bc4c0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:20.832076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6fcbca5b-e633-4648-ad6a-f97bb711cb53 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1824757023" status: 202 len: 0 microversion: 2.1 time: 0.050879 Jun 06 21:08:20.837256 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 230/454] 10.222.0.33 () {58 vars in 1220 bytes} [Mon Jun 6 21:08:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1824757023 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:08:20.854395 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-c2ea83da-10de-47a5-9b30-7f7a040abd2b req-e1ffc792-627e-47f4-9f69-182f70a418cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1886e3bf-c735-4f91-8a2f-0bc6996982e0", "name": "network-vif-plugged", "status": "completed", "tag": "2e4dc91b-9fa1-4ca1-9827-0ca3ef02a18e"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:20.876540 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-c2ea83da-10de-47a5-9b30-7f7a040abd2b req-e1ffc792-627e-47f4-9f69-182f70a418cc service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:20.877054 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-c2ea83da-10de-47a5-9b30-7f7a040abd2b req-e1ffc792-627e-47f4-9f69-182f70a418cc service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:20.907432 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-c2ea83da-10de-47a5-9b30-7f7a040abd2b req-e1ffc792-627e-47f4-9f69-182f70a418cc service nova] Creating event network-vif-plugged:2e4dc91b-9fa1-4ca1-9827-0ca3ef02a18e for instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 on hv-cinder-84488 Jun 06 21:08:20.917813 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-c2ea83da-10de-47a5-9b30-7f7a040abd2b req-e1ffc792-627e-47f4-9f69-182f70a418cc service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068838 Jun 06 21:08:20.918486 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 231/455] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:08:20.924499 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-586fd54b-7e17-4516-9944-c0268f81adc4 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:20.942324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-586fd54b-7e17-4516-9944-c0268f81adc4 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1259 microversion: 2.1 time: 0.450727 Jun 06 21:08:20.952112 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 225/456] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:20 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1259 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:21.062522 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8f4b953c-3aed-464f-a094-99e472b21e57 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:21.063557 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8f4b953c-3aed-464f-a094-99e472b21e57 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:21.078700 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8f4b953c-3aed-464f-a094-99e472b21e57 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:21.079294 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8f4b953c-3aed-464f-a094-99e472b21e57 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:21.081890 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8f4b953c-3aed-464f-a094-99e472b21e57 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:21.082299 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8f4b953c-3aed-464f-a094-99e472b21e57 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:21.377842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8f4b953c-3aed-464f-a094-99e472b21e57 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:21.407730 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8f4b953c-3aed-464f-a094-99e472b21e57 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1318 microversion: 2.1 time: 0.371444 Jun 06 21:08:21.428319 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 232/457] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:21 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:21.459047 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-aadc0633-327b-4c30-a926-1d7844551494 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:21.460444 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-aadc0633-327b-4c30-a926-1d7844551494 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:21.483660 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-aadc0633-327b-4c30-a926-1d7844551494 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:21.484999 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-aadc0633-327b-4c30-a926-1d7844551494 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:21.486686 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-aadc0633-327b-4c30-a926-1d7844551494 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:21.487654 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-aadc0633-327b-4c30-a926-1d7844551494 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:21.797146 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-76e5402e-31cc-474b-a39f-5a23b7b8c13b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:21.798038 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-76e5402e-31cc-474b-a39f-5a23b7b8c13b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:21.808781 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76e5402e-31cc-474b-a39f-5a23b7b8c13b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:21.809585 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76e5402e-31cc-474b-a39f-5a23b7b8c13b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:21.810600 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76e5402e-31cc-474b-a39f-5a23b7b8c13b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:21.811154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76e5402e-31cc-474b-a39f-5a23b7b8c13b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:21.870708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-aadc0633-327b-4c30-a926-1d7844551494 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:21.915950 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-aadc0633-327b-4c30-a926-1d7844551494 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:21.921150 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-aadc0633-327b-4c30-a926-1d7844551494 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:21.923761 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-aadc0633-327b-4c30-a926-1d7844551494 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.481328 Jun 06 21:08:21.943783 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 226/458] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:08:21 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:08:21.976646 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-912c1476-bf00-48db-8fec-835c0d521925 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:21.977786 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-912c1476-bf00-48db-8fec-835c0d521925 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:22.005528 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-912c1476-bf00-48db-8fec-835c0d521925 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:22.006494 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-912c1476-bf00-48db-8fec-835c0d521925 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:22.007969 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-912c1476-bf00-48db-8fec-835c0d521925 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:22.008551 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-912c1476-bf00-48db-8fec-835c0d521925 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:22.050281 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-76e5402e-31cc-474b-a39f-5a23b7b8c13b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:22.064587 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-76e5402e-31cc-474b-a39f-5a23b7b8c13b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1508 microversion: 2.1 time: 0.270988 Jun 06 21:08:22.065495 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 233/459] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:21 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1508 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:22.323848 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-912c1476-bf00-48db-8fec-835c0d521925 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:22.335404 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-912c1476-bf00-48db-8fec-835c0d521925 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1259 microversion: 2.1 time: 0.363913 Jun 06 21:08:22.336099 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 227/460] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:21 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1259 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:08:22.397069 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-dbee3c3b-9c9d-46f5-92ff-de396cc22ab4 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:22.397643 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-dbee3c3b-9c9d-46f5-92ff-de396cc22ab4 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:22.405169 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dbee3c3b-9c9d-46f5-92ff-de396cc22ab4 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:22.405627 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dbee3c3b-9c9d-46f5-92ff-de396cc22ab4 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:22.406436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dbee3c3b-9c9d-46f5-92ff-de396cc22ab4 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:22.407962 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dbee3c3b-9c9d-46f5-92ff-de396cc22ab4 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:22.455719 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-a8d08a92-3a17-4643-b29e-70cb513b2816 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:22.456793 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-a8d08a92-3a17-4643-b29e-70cb513b2816 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:22.459427 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=100 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:22.477866 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a8d08a92-3a17-4643-b29e-70cb513b2816 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:22.478621 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a8d08a92-3a17-4643-b29e-70cb513b2816 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:22.479649 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a8d08a92-3a17-4643-b29e-70cb513b2816 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:22.480433 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a8d08a92-3a17-4643-b29e-70cb513b2816 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:22.574452 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:22.588425 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-dbee3c3b-9c9d-46f5-92ff-de396cc22ab4 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lazy-loading 'services' on Instance uuid 67813627-cc4f-453f-8b8f-9cec9b130583 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:08:22.697696 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-a8d08a92-3a17-4643-b29e-70cb513b2816 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:22.714582 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-a8d08a92-3a17-4643-b29e-70cb513b2816 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1318 microversion: 2.1 time: 0.262955 Jun 06 21:08:22.715550 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 228/461] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:22 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:22.756688 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-dbee3c3b-9c9d-46f5-92ff-de396cc22ab4 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "DELETE /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583/os-volume_attachments/0aae6ddd-8aed-4286-9ebd-c429736820bf" status: 202 len: 0 microversion: 2.1 time: 0.362862 Jun 06 21:08:22.757935 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 234/462] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 6 21:08:22 2022] DELETE /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583/os-volume_attachments/0aae6ddd-8aed-4286-9ebd-c429736820bf => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:08:22.768177 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-d66c1e94-c25a-4111-a0a9-3724b452533d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:22.769849 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-d66c1e94-c25a-4111-a0a9-3724b452533d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:22.777959 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d66c1e94-c25a-4111-a0a9-3724b452533d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:22.778429 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d66c1e94-c25a-4111-a0a9-3724b452533d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:22.779667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d66c1e94-c25a-4111-a0a9-3724b452533d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:22.780457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d66c1e94-c25a-4111-a0a9-3724b452533d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:22.818952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-d66c1e94-c25a-4111-a0a9-3724b452533d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056749 Jun 06 21:08:22.820026 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 229/463] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 6 21:08:22 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:08:22.953538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-752f6135-1e1e-4148-ac71-ba85bd9c6db0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:22.954402 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-752f6135-1e1e-4148-ac71-ba85bd9c6db0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:22.961460 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-752f6135-1e1e-4148-ac71-ba85bd9c6db0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:22.962476 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-752f6135-1e1e-4148-ac71-ba85bd9c6db0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:22.963282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-752f6135-1e1e-4148-ac71-ba85bd9c6db0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:22.963740 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-752f6135-1e1e-4148-ac71-ba85bd9c6db0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:23.082741 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-d4369bea-3106-4ebc-a650-ad4cbb1f85f9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:23.083355 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-d4369bea-3106-4ebc-a650-ad4cbb1f85f9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:23.090259 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d4369bea-3106-4ebc-a650-ad4cbb1f85f9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:23.090475 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d4369bea-3106-4ebc-a650-ad4cbb1f85f9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:23.091253 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d4369bea-3106-4ebc-a650-ad4cbb1f85f9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:23.091693 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d4369bea-3106-4ebc-a650-ad4cbb1f85f9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:23.107804 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-752f6135-1e1e-4148-ac71-ba85bd9c6db0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:23.118463 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-752f6135-1e1e-4148-ac71-ba85bd9c6db0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:23.119887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-752f6135-1e1e-4148-ac71-ba85bd9c6db0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:23.121687 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-752f6135-1e1e-4148-ac71-ba85bd9c6db0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.173884 Jun 06 21:08:23.122533 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 235/464] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:08:22 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:08:23.236145 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-d4369bea-3106-4ebc-a650-ad4cbb1f85f9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:23.244033 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-d4369bea-3106-4ebc-a650-ad4cbb1f85f9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1508 microversion: 2.1 time: 0.165609 Jun 06 21:08:23.244628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 230/465] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:23 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:23.353191 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c8cc963d-e38a-45f0-ae9f-d4468b42ec25 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:23.353827 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c8cc963d-e38a-45f0-ae9f-d4468b42ec25 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:23.361548 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8cc963d-e38a-45f0-ae9f-d4468b42ec25 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:23.361997 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8cc963d-e38a-45f0-ae9f-d4468b42ec25 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:23.362771 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8cc963d-e38a-45f0-ae9f-d4468b42ec25 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:23.363201 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8cc963d-e38a-45f0-ae9f-d4468b42ec25 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:23.506444 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c8cc963d-e38a-45f0-ae9f-d4468b42ec25 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:23.516389 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c8cc963d-e38a-45f0-ae9f-d4468b42ec25 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1259 microversion: 2.1 time: 0.167442 Jun 06 21:08:23.516976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 236/466] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:23 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:23.741011 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-63d78446-02cd-4da0-b7a0-4038a3dd66d7 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:23.741668 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-63d78446-02cd-4da0-b7a0-4038a3dd66d7 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:23.749048 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-63d78446-02cd-4da0-b7a0-4038a3dd66d7 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:23.749494 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-63d78446-02cd-4da0-b7a0-4038a3dd66d7 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:23.750263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-63d78446-02cd-4da0-b7a0-4038a3dd66d7 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:23.750691 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-63d78446-02cd-4da0-b7a0-4038a3dd66d7 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:23.832224 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c5e0073e-cf41-4a07-bd94-99f16c455325 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:23.833225 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c5e0073e-cf41-4a07-bd94-99f16c455325 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:23.840218 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c5e0073e-cf41-4a07-bd94-99f16c455325 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:23.840457 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c5e0073e-cf41-4a07-bd94-99f16c455325 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:23.841123 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c5e0073e-cf41-4a07-bd94-99f16c455325 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:23.841712 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c5e0073e-cf41-4a07-bd94-99f16c455325 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:23.875328 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c5e0073e-cf41-4a07-bd94-99f16c455325 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047395 Jun 06 21:08:23.875918 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 237/467] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 6 21:08:23 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:08:23.901841 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-63d78446-02cd-4da0-b7a0-4038a3dd66d7 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:23.910021 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-63d78446-02cd-4da0-b7a0-4038a3dd66d7 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1318 microversion: 2.1 time: 0.173258 Jun 06 21:08:23.910605 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 231/468] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:23 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:24.140762 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-646ea437-9d53-45f6-b566-4248caed46ab tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:24.141380 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-646ea437-9d53-45f6-b566-4248caed46ab tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:24.148410 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-646ea437-9d53-45f6-b566-4248caed46ab tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:24.148865 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-646ea437-9d53-45f6-b566-4248caed46ab tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:24.149679 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-646ea437-9d53-45f6-b566-4248caed46ab tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:24.150117 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-646ea437-9d53-45f6-b566-4248caed46ab tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:24.262258 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e75abf4f-470e-43d8-ac43-c6a17c676e1f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:24.263070 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-e75abf4f-470e-43d8-ac43-c6a17c676e1f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:24.269980 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e75abf4f-470e-43d8-ac43-c6a17c676e1f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:24.270580 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e75abf4f-470e-43d8-ac43-c6a17c676e1f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:24.271487 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e75abf4f-470e-43d8-ac43-c6a17c676e1f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:24.272009 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e75abf4f-470e-43d8-ac43-c6a17c676e1f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:24.296581 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-646ea437-9d53-45f6-b566-4248caed46ab tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:24.307948 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-646ea437-9d53-45f6-b566-4248caed46ab tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:24.309578 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-646ea437-9d53-45f6-b566-4248caed46ab tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:24.310938 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-646ea437-9d53-45f6-b566-4248caed46ab tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.174669 Jun 06 21:08:24.322404 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 238/469] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:08:24 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:08:24.418028 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e75abf4f-470e-43d8-ac43-c6a17c676e1f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:24.426725 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-e75abf4f-470e-43d8-ac43-c6a17c676e1f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1508 microversion: 2.1 time: 0.168429 Jun 06 21:08:24.427312 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 232/470] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:24 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:24.429309 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-6d52cb32-9a21-46c9-8f33-28f50553a1d5 req-119ffbca-998b-4bc7-b475-94124e925477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b2b83bd-e8cf-4d4e-8048-20336a5d21e5", "name": "network-vif-plugged", "status": "completed", "tag": "8ebfa5e0-f4fb-4ca5-a0c9-947b5ca291f7"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:24.438075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-6d52cb32-9a21-46c9-8f33-28f50553a1d5 req-119ffbca-998b-4bc7-b475-94124e925477 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:24.438504 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-6d52cb32-9a21-46c9-8f33-28f50553a1d5 req-119ffbca-998b-4bc7-b475-94124e925477 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:24.450570 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-6d52cb32-9a21-46c9-8f33-28f50553a1d5 req-119ffbca-998b-4bc7-b475-94124e925477 service nova] Creating event network-vif-plugged:8ebfa5e0-f4fb-4ca5-a0c9-947b5ca291f7 for instance 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 on hv-cinder-84488 Jun 06 21:08:24.456505 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-6d52cb32-9a21-46c9-8f33-28f50553a1d5 req-119ffbca-998b-4bc7-b475-94124e925477 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030996 Jun 06 21:08:24.457121 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 239/471] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:08:24.534259 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-885d7666-df8f-4e7f-b0bf-114a4e58bcab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:24.536351 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-885d7666-df8f-4e7f-b0bf-114a4e58bcab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:24.543041 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-885d7666-df8f-4e7f-b0bf-114a4e58bcab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:24.543394 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-885d7666-df8f-4e7f-b0bf-114a4e58bcab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:24.544280 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-885d7666-df8f-4e7f-b0bf-114a4e58bcab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:24.544856 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-885d7666-df8f-4e7f-b0bf-114a4e58bcab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:24.691866 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-885d7666-df8f-4e7f-b0bf-114a4e58bcab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:24.699579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-885d7666-df8f-4e7f-b0bf-114a4e58bcab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1259 microversion: 2.1 time: 0.169686 Jun 06 21:08:24.700429 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 233/472] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:24 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:24.903652 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4b17a35c-5787-474b-b3ca-7b3089e7ce52 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:24.904842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4b17a35c-5787-474b-b3ca-7b3089e7ce52 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:24.912145 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b17a35c-5787-474b-b3ca-7b3089e7ce52 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:24.912649 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b17a35c-5787-474b-b3ca-7b3089e7ce52 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:24.913421 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b17a35c-5787-474b-b3ca-7b3089e7ce52 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:24.913849 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4b17a35c-5787-474b-b3ca-7b3089e7ce52 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:24.928806 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-85fd4245-3739-4972-8d5d-da077f219eeb tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:24.929672 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-85fd4245-3739-4972-8d5d-da077f219eeb tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:24.940157 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-85fd4245-3739-4972-8d5d-da077f219eeb tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:24.940797 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-85fd4245-3739-4972-8d5d-da077f219eeb tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:24.941898 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-85fd4245-3739-4972-8d5d-da077f219eeb tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:24.942466 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-85fd4245-3739-4972-8d5d-da077f219eeb tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:24.954349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4b17a35c-5787-474b-b3ca-7b3089e7ce52 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059702 Jun 06 21:08:24.955276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 240/473] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 6 21:08:24 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:08:25.109587 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-85fd4245-3739-4972-8d5d-da077f219eeb tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:25.117331 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-85fd4245-3739-4972-8d5d-da077f219eeb tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1318 microversion: 2.1 time: 0.193609 Jun 06 21:08:25.118031 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 234/474] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:24 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:25.331921 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7c6f7a3f-30a0-4891-85ad-5f3790c59505 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:25.332423 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7c6f7a3f-30a0-4891-85ad-5f3790c59505 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:25.339524 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7c6f7a3f-30a0-4891-85ad-5f3790c59505 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:25.340375 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7c6f7a3f-30a0-4891-85ad-5f3790c59505 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:25.341698 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7c6f7a3f-30a0-4891-85ad-5f3790c59505 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:25.342318 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7c6f7a3f-30a0-4891-85ad-5f3790c59505 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:25.444712 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-4bf1f2e9-88f5-4842-a304-b7e7b13862bf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:25.445328 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-4bf1f2e9-88f5-4842-a304-b7e7b13862bf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:25.453474 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4bf1f2e9-88f5-4842-a304-b7e7b13862bf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:25.453924 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4bf1f2e9-88f5-4842-a304-b7e7b13862bf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:25.454726 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4bf1f2e9-88f5-4842-a304-b7e7b13862bf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:25.455156 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4bf1f2e9-88f5-4842-a304-b7e7b13862bf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:25.473069 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:25.511738 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7c6f7a3f-30a0-4891-85ad-5f3790c59505 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:25.523131 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7c6f7a3f-30a0-4891-85ad-5f3790c59505 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:25.526487 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7c6f7a3f-30a0-4891-85ad-5f3790c59505 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:25.528689 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7c6f7a3f-30a0-4891-85ad-5f3790c59505 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1809 microversion: 2.20 time: 0.201469 Jun 06 21:08:25.529277 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 241/475] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:08:25 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:08:25.628522 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-4bf1f2e9-88f5-4842-a304-b7e7b13862bf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:25.637732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-4bf1f2e9-88f5-4842-a304-b7e7b13862bf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1508 microversion: 2.1 time: 0.196808 Jun 06 21:08:25.648335 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 235/476] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:25 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1508 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:25.722382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8df48159-6026-4278-8e2e-74e160343746 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:25.723268 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8df48159-6026-4278-8e2e-74e160343746 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:25.730319 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8df48159-6026-4278-8e2e-74e160343746 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:25.731112 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8df48159-6026-4278-8e2e-74e160343746 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:25.732107 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8df48159-6026-4278-8e2e-74e160343746 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:25.732702 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8df48159-6026-4278-8e2e-74e160343746 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:25.882916 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8df48159-6026-4278-8e2e-74e160343746 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:25.892729 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8df48159-6026-4278-8e2e-74e160343746 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1259 microversion: 2.1 time: 0.179205 Jun 06 21:08:25.893310 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 242/477] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:25 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1259 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:25.972983 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-52f78bb5-d4a4-423f-a9d9-b556327347a5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:25.972983 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-52f78bb5-d4a4-423f-a9d9-b556327347a5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:25.981655 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-52f78bb5-d4a4-423f-a9d9-b556327347a5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:25.982115 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-52f78bb5-d4a4-423f-a9d9-b556327347a5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:25.982901 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-52f78bb5-d4a4-423f-a9d9-b556327347a5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:25.983323 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-52f78bb5-d4a4-423f-a9d9-b556327347a5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:26.015826 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-52f78bb5-d4a4-423f-a9d9-b556327347a5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052673 Jun 06 21:08:26.016447 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 236/478] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 6 21:08:25 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 21:08:26.077153 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1b06b482-3193-4ad1-afc2-ce4eb4f46c9f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:26.077669 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1b06b482-3193-4ad1-afc2-ce4eb4f46c9f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:26.084370 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1b06b482-3193-4ad1-afc2-ce4eb4f46c9f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:26.084820 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1b06b482-3193-4ad1-afc2-ce4eb4f46c9f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:26.085582 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1b06b482-3193-4ad1-afc2-ce4eb4f46c9f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:26.086020 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1b06b482-3193-4ad1-afc2-ce4eb4f46c9f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:26.113089 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1b06b482-3193-4ad1-afc2-ce4eb4f46c9f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 21:08:26.134824 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-57f3fd02-66e8-48c1-b019-154f44ee245c tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:26.135456 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-57f3fd02-66e8-48c1-b019-154f44ee245c tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:26.142219 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-57f3fd02-66e8-48c1-b019-154f44ee245c tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:26.142657 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-57f3fd02-66e8-48c1-b019-154f44ee245c tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:26.143419 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-57f3fd02-66e8-48c1-b019-154f44ee245c tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:26.143841 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-57f3fd02-66e8-48c1-b019-154f44ee245c tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:26.226336 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1b06b482-3193-4ad1-afc2-ce4eb4f46c9f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "DELETE /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 204 len: 0 microversion: 2.1 time: 0.152689 Jun 06 21:08:26.226786 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 243/479] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:08:26 2022] DELETE /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 21:08:26.236155 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2876ceb5-e750-4f17-abae-a772ce3fe55c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:26.236994 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2876ceb5-e750-4f17-abae-a772ce3fe55c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:26.243361 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2876ceb5-e750-4f17-abae-a772ce3fe55c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:26.243844 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2876ceb5-e750-4f17-abae-a772ce3fe55c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:26.244830 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2876ceb5-e750-4f17-abae-a772ce3fe55c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:26.245283 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2876ceb5-e750-4f17-abae-a772ce3fe55c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:26.299716 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-57f3fd02-66e8-48c1-b019-154f44ee245c tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:26.308149 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-57f3fd02-66e8-48c1-b019-154f44ee245c tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1318 microversion: 2.1 time: 0.177051 Jun 06 21:08:26.308903 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 237/480] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:26 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:08:26.391171 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2876ceb5-e750-4f17-abae-a772ce3fe55c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:26.401567 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2876ceb5-e750-4f17-abae-a772ce3fe55c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 200 len: 1683 microversion: 2.1 time: 0.169789 Jun 06 21:08:26.402387 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 244/481] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:26 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 1683 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:08:26.495514 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-30daa1bb-fe71-408a-b541-04b71f9db0b1 req-244c87ab-3688-4557-8612-c1f935984ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807baad3-4d23-4d63-b4a9-7163fc77e302", "name": "network-vif-plugged", "status": "completed", "tag": "98717e19-2897-4922-9eb5-8ca664fad7a8"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:26.505525 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-30daa1bb-fe71-408a-b541-04b71f9db0b1 req-244c87ab-3688-4557-8612-c1f935984ba8 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:26.505956 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-30daa1bb-fe71-408a-b541-04b71f9db0b1 req-244c87ab-3688-4557-8612-c1f935984ba8 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:26.518738 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-30daa1bb-fe71-408a-b541-04b71f9db0b1 req-244c87ab-3688-4557-8612-c1f935984ba8 service nova] Creating event network-vif-plugged:98717e19-2897-4922-9eb5-8ca664fad7a8 for instance 807baad3-4d23-4d63-b4a9-7163fc77e302 on hv-cinder-84488 Jun 06 21:08:26.524264 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-30daa1bb-fe71-408a-b541-04b71f9db0b1 req-244c87ab-3688-4557-8612-c1f935984ba8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034448 Jun 06 21:08:26.524925 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 238/482] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:08:26.547327 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-03e4184f-87d6-4f8a-b6da-5069c2bff309 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:26.547928 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-03e4184f-87d6-4f8a-b6da-5069c2bff309 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:26.556191 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-03e4184f-87d6-4f8a-b6da-5069c2bff309 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:26.556795 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-03e4184f-87d6-4f8a-b6da-5069c2bff309 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:26.558148 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-03e4184f-87d6-4f8a-b6da-5069c2bff309 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:26.558946 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-03e4184f-87d6-4f8a-b6da-5069c2bff309 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:26.655276 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-3395b64d-d653-487f-a1a9-bf4d149cd1f3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:26.655982 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-3395b64d-d653-487f-a1a9-bf4d149cd1f3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:26.662752 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3395b64d-d653-487f-a1a9-bf4d149cd1f3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:26.663188 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3395b64d-d653-487f-a1a9-bf4d149cd1f3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:26.663953 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3395b64d-d653-487f-a1a9-bf4d149cd1f3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:26.664408 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3395b64d-d653-487f-a1a9-bf4d149cd1f3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:26.700023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-03e4184f-87d6-4f8a-b6da-5069c2bff309 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:26.709787 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-03e4184f-87d6-4f8a-b6da-5069c2bff309 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:26.711268 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-03e4184f-87d6-4f8a-b6da-5069c2bff309 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:26.712545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-03e4184f-87d6-4f8a-b6da-5069c2bff309 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1796 microversion: 2.20 time: 0.169327 Jun 06 21:08:26.713083 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 245/483] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:08:26 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1796 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:08:26.812514 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-3395b64d-d653-487f-a1a9-bf4d149cd1f3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:26.821712 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-3395b64d-d653-487f-a1a9-bf4d149cd1f3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1514 microversion: 2.1 time: 0.170514 Jun 06 21:08:26.822378 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 239/484] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:26 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:08:26.911380 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b97e745e-abcc-4685-8fde-779915f354b6 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:26.912551 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b97e745e-abcc-4685-8fde-779915f354b6 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:26.914672 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:26.920831 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b97e745e-abcc-4685-8fde-779915f354b6 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:26.921075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b97e745e-abcc-4685-8fde-779915f354b6 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:26.921846 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b97e745e-abcc-4685-8fde-779915f354b6 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:26.922320 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b97e745e-abcc-4685-8fde-779915f354b6 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:27.078750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b97e745e-abcc-4685-8fde-779915f354b6 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:27.087242 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b97e745e-abcc-4685-8fde-779915f354b6 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1259 microversion: 2.1 time: 0.180308 Jun 06 21:08:27.088202 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 246/485] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:26 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:08:27.327513 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-31705448-3737-4d5b-8474-24506025e8d3 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:27.328495 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-31705448-3737-4d5b-8474-24506025e8d3 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:27.335698 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-31705448-3737-4d5b-8474-24506025e8d3 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:27.336210 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-31705448-3737-4d5b-8474-24506025e8d3 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:27.336937 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-31705448-3737-4d5b-8474-24506025e8d3 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:27.337391 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-31705448-3737-4d5b-8474-24506025e8d3 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:27.422790 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fb9d8491-bf35-44d8-baa6-d4f42ace6c11 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:27.423815 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fb9d8491-bf35-44d8-baa6-d4f42ace6c11 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:27.430334 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb9d8491-bf35-44d8-baa6-d4f42ace6c11 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:27.430779 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb9d8491-bf35-44d8-baa6-d4f42ace6c11 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:27.431583 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb9d8491-bf35-44d8-baa6-d4f42ace6c11 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:27.431982 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb9d8491-bf35-44d8-baa6-d4f42ace6c11 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:27.481772 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-31705448-3737-4d5b-8474-24506025e8d3 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:27.487910 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-31705448-3737-4d5b-8474-24506025e8d3 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1318 microversion: 2.1 time: 0.165053 Jun 06 21:08:27.488532 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 240/486] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:27 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:27.574899 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fb9d8491-bf35-44d8-baa6-d4f42ace6c11 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:27.583407 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fb9d8491-bf35-44d8-baa6-d4f42ace6c11 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 200 len: 1683 microversion: 2.1 time: 0.165272 Jun 06 21:08:27.583915 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 247/487] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:27 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:08:28.106589 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-44ac8bb6-e0c6-4f5d-97cb-75594ad8c72a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:28.107234 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-44ac8bb6-e0c6-4f5d-97cb-75594ad8c72a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:28.116202 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-44ac8bb6-e0c6-4f5d-97cb-75594ad8c72a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:28.116669 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-44ac8bb6-e0c6-4f5d-97cb-75594ad8c72a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:28.117530 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-44ac8bb6-e0c6-4f5d-97cb-75594ad8c72a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:28.117967 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-44ac8bb6-e0c6-4f5d-97cb-75594ad8c72a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:28.222854 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-850fb654-6070-4c64-aaba-e470a971f2ab tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Action: 'create', calling method: .version_select at 0x7f2725807670>, body: {"keypair": {"name": "tempest-keypair-998164194", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIkwb//QNrCWNLjCoGx7rf7T8H8FVozFQPSEZWPGB2DK9+j6WuDktR5X9B7I7tTT/ake6cd42Wu94UlKJc3BFIxNwDxqb9GO13QEE3RAazHaX7QD+2JgMcBHEB3OLbF7Qg=="}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:28.238378 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-850fb654-6070-4c64-aaba-e470a971f2ab tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Getting quotas for project f0246519bc2240cf8d1ba54172c0faca. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:08:28.242708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-850fb654-6070-4c64-aaba-e470a971f2ab tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Getting quotas for user ab9da673f40b4e3eb541fdc380cfe282 and project f0246519bc2240cf8d1ba54172c0faca. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:08:28.275804 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-850fb654-6070-4c64-aaba-e470a971f2ab tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057067 Jun 06 21:08:28.277507 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 248/488] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jun 6 21:08:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:08:28.291118 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-44ac8bb6-e0c6-4f5d-97cb-75594ad8c72a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:28.299276 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-44ac8bb6-e0c6-4f5d-97cb-75594ad8c72a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1259 microversion: 2.1 time: 0.197123 Jun 06 21:08:28.299872 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 241/489] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:28 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:28.506865 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ba9423b9-d065-4b8d-ae0a-3dc0e54b5288 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:28.507453 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ba9423b9-d065-4b8d-ae0a-3dc0e54b5288 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:28.515578 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ba9423b9-d065-4b8d-ae0a-3dc0e54b5288 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:28.516277 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ba9423b9-d065-4b8d-ae0a-3dc0e54b5288 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:28.517544 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ba9423b9-d065-4b8d-ae0a-3dc0e54b5288 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:28.518115 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ba9423b9-d065-4b8d-ae0a-3dc0e54b5288 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:28.603413 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-5eb9bff6-e1fa-4819-8122-8596fce3d3bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:28.605057 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-5eb9bff6-e1fa-4819-8122-8596fce3d3bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:28.614088 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5eb9bff6-e1fa-4819-8122-8596fce3d3bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:28.614695 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5eb9bff6-e1fa-4819-8122-8596fce3d3bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:28.615563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5eb9bff6-e1fa-4819-8122-8596fce3d3bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:28.616283 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5eb9bff6-e1fa-4819-8122-8596fce3d3bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:28.687907 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ba9423b9-d065-4b8d-ae0a-3dc0e54b5288 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:28.700454 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ba9423b9-d065-4b8d-ae0a-3dc0e54b5288 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1506 microversion: 2.1 time: 0.197217 Jun 06 21:08:28.702118 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 249/490] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:28 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:28.888218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-5eb9bff6-e1fa-4819-8122-8596fce3d3bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:28.897536 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-5eb9bff6-e1fa-4819-8122-8596fce3d3bf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 200 len: 1683 microversion: 2.1 time: 0.298956 Jun 06 21:08:28.898211 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 242/491] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:28 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 1683 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:29.320711 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-672846ce-6094-447c-883b-18fdfce3da68 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:29.321687 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-672846ce-6094-447c-883b-18fdfce3da68 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:29.338463 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-672846ce-6094-447c-883b-18fdfce3da68 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:29.339180 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-672846ce-6094-447c-883b-18fdfce3da68 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:29.350213 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-672846ce-6094-447c-883b-18fdfce3da68 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:29.351013 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-672846ce-6094-447c-883b-18fdfce3da68 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:29.675231 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-672846ce-6094-447c-883b-18fdfce3da68 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:29.677555 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:29.687073 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-672846ce-6094-447c-883b-18fdfce3da68 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1259 microversion: 2.1 time: 0.372709 Jun 06 21:08:29.697476 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 250/492] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:29 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1259 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:29.916667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-95b82513-3ecc-4c56-8024-5ba055ab1cdc tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:29.917288 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-95b82513-3ecc-4c56-8024-5ba055ab1cdc tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:29.924292 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-95b82513-3ecc-4c56-8024-5ba055ab1cdc tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:29.924738 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-95b82513-3ecc-4c56-8024-5ba055ab1cdc tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:29.925958 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-95b82513-3ecc-4c56-8024-5ba055ab1cdc tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:29.926323 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-95b82513-3ecc-4c56-8024-5ba055ab1cdc tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:30.186158 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-95b82513-3ecc-4c56-8024-5ba055ab1cdc tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:30.196459 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-95b82513-3ecc-4c56-8024-5ba055ab1cdc tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 200 len: 1616 microversion: 2.1 time: 0.284121 Jun 06 21:08:30.197491 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 243/493] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:29 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 1616 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:30.298223 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3acfb006-c2b4-49e0-b220-445c2aa17b0b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1650154094", "imageRef": "e4266a01-7d22-4036-91e8-3ec50e3369c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9bdfa114-ca93-4485-b7b6-8e22817f3380"}], "security_groups": [{"name": "tempest-securitygroup--1040872152"}], "key_name": "tempest-keypair-998164194", "user_data": "}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:30.484599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-3acfb006-c2b4-49e0-b220-445c2aa17b0b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] validate_networks() for [('9bdfa114-ca93-4485-b7b6-8e22817f3380', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 21:08:30.523559 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-09aaeea4-a599-4241-b758-a8b5617f816f req-49fa1a8e-5369-4d85-b0b5-803bf98ba100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67813627-cc4f-453f-8b8f-9cec9b130583", "name": "network-vif-deleted", "tag": "efe64743-231a-4a9a-84a9-a1c7d29a5935"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:30.533421 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-09aaeea4-a599-4241-b758-a8b5617f816f req-49fa1a8e-5369-4d85-b0b5-803bf98ba100 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:30.534456 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-09aaeea4-a599-4241-b758-a8b5617f816f req-49fa1a8e-5369-4d85-b0b5-803bf98ba100 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:30.547027 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-09aaeea4-a599-4241-b758-a8b5617f816f req-49fa1a8e-5369-4d85-b0b5-803bf98ba100 service nova] Creating event network-vif-deleted:efe64743-231a-4a9a-84a9-a1c7d29a5935 for instance 67813627-cc4f-453f-8b8f-9cec9b130583 on hv-cinder-84488 Jun 06 21:08:30.552929 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-09aaeea4-a599-4241-b758-a8b5617f816f req-49fa1a8e-5369-4d85-b0b5-803bf98ba100 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032987 Jun 06 21:08:30.554148 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 244/494] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:08:30.707152 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-347f0742-51b8-4c44-b549-efc776fff49b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:30.708320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-347f0742-51b8-4c44-b549-efc776fff49b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:30.717221 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-347f0742-51b8-4c44-b549-efc776fff49b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:30.717867 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-347f0742-51b8-4c44-b549-efc776fff49b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:30.718761 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-347f0742-51b8-4c44-b549-efc776fff49b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:30.719300 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-347f0742-51b8-4c44-b549-efc776fff49b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:30.909950 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-347f0742-51b8-4c44-b549-efc776fff49b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:30.919176 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-347f0742-51b8-4c44-b549-efc776fff49b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1259 microversion: 2.1 time: 0.216985 Jun 06 21:08:30.929090 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 245/495] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:30 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:31.222513 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-1c639ea9-a5b6-45cb-9707-39efac6e8432 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:31.223248 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-1c639ea9-a5b6-45cb-9707-39efac6e8432 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:31.230936 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1c639ea9-a5b6-45cb-9707-39efac6e8432 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:31.231851 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1c639ea9-a5b6-45cb-9707-39efac6e8432 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:31.232880 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1c639ea9-a5b6-45cb-9707-39efac6e8432 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:31.233500 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1c639ea9-a5b6-45cb-9707-39efac6e8432 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:31.273187 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1c639ea9-a5b6-45cb-9707-39efac6e8432 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:31.273683 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1c639ea9-a5b6-45cb-9707-39efac6e8432 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:31.274236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.objects.instance [None req-1c639ea9-a5b6-45cb-9707-39efac6e8432 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lazy-loading 'fault' on Instance uuid 67813627-cc4f-453f-8b8f-9cec9b130583 {{(pid=117860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:08:31.337520 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-1c639ea9-a5b6-45cb-9707-39efac6e8432 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:31.346939 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-1c639ea9-a5b6-45cb-9707-39efac6e8432 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 200 len: 1332 microversion: 2.1 time: 0.134025 Jun 06 21:08:31.352335 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 246/496] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:31 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 1332 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:31.467541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-3acfb006-c2b4-49e0-b220-445c2aa17b0b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 21:08:31.470781 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-3acfb006-c2b4-49e0-b220-445c2aa17b0b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 21:08:31.470781 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-3acfb006-c2b4-49e0-b220-445c2aa17b0b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 21:08:31.470781 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-3acfb006-c2b4-49e0-b220-445c2aa17b0b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 21:08:31.470781 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-3acfb006-c2b4-49e0-b220-445c2aa17b0b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 21:08:31.488960 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3acfb006-c2b4-49e0-b220-445c2aa17b0b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:31.489469 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3acfb006-c2b4-49e0-b220-445c2aa17b0b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:31.490296 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3acfb006-c2b4-49e0-b220-445c2aa17b0b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:31.490716 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3acfb006-c2b4-49e0-b220-445c2aa17b0b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:31.515869 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-3acfb006-c2b4-49e0-b220-445c2aa17b0b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Getting quotas for project f0246519bc2240cf8d1ba54172c0faca. Resources: {'ram', 'cores', 'instances'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:08:31.523047 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-3acfb006-c2b4-49e0-b220-445c2aa17b0b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Getting quotas for user ab9da673f40b4e3eb541fdc380cfe282 and project f0246519bc2240cf8d1ba54172c0faca. Resources: {'ram', 'cores', 'instances'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:08:31.551070 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3acfb006-c2b4-49e0-b220-445c2aa17b0b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 21:08:31.554463 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3acfb006-c2b4-49e0-b220-445c2aa17b0b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4266a01-7d22-4036-91e8-3ec50e3369c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 21:08:31.625213 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3acfb006-c2b4-49e0-b220-445c2aa17b0b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.331980 Jun 06 21:08:31.626823 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 251/497] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 6 21:08:30 2022] POST /compute/v2.1/servers => generated 409 bytes in 1334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 21:08:31.640843 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-9a87c3cf-be24-48ad-936a-b86bc624c5be tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:31.641914 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-9a87c3cf-be24-48ad-936a-b86bc624c5be tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:31.713206 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-9a87c3cf-be24-48ad-936a-b86bc624c5be tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:31.721533 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-9a87c3cf-be24-48ad-936a-b86bc624c5be tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1245 microversion: 2.1 time: 0.088263 Jun 06 21:08:31.722417 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 247/498] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:31 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:31.937632 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-03b5ca16-72b2-44b1-89f2-1c4b2e1e12ab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:31.938483 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-03b5ca16-72b2-44b1-89f2-1c4b2e1e12ab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:31.945087 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-03b5ca16-72b2-44b1-89f2-1c4b2e1e12ab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:31.945762 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-03b5ca16-72b2-44b1-89f2-1c4b2e1e12ab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:31.946532 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-03b5ca16-72b2-44b1-89f2-1c4b2e1e12ab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:31.946967 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-03b5ca16-72b2-44b1-89f2-1c4b2e1e12ab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:32.104981 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-03b5ca16-72b2-44b1-89f2-1c4b2e1e12ab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:32.113903 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-03b5ca16-72b2-44b1-89f2-1c4b2e1e12ab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1443 microversion: 2.1 time: 0.180995 Jun 06 21:08:32.114495 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 252/499] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:31 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1443 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:32.132103 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-9fed3932-ae38-420b-b70a-0c968b7e54df tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:32.132785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-9fed3932-ae38-420b-b70a-0c968b7e54df tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:32.139632 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9fed3932-ae38-420b-b70a-0c968b7e54df tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:32.140101 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9fed3932-ae38-420b-b70a-0c968b7e54df tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:32.140873 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9fed3932-ae38-420b-b70a-0c968b7e54df tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:32.141300 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9fed3932-ae38-420b-b70a-0c968b7e54df tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:32.287164 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-9fed3932-ae38-420b-b70a-0c968b7e54df tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:32.297731 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-9fed3932-ae38-420b-b70a-0c968b7e54df tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1443 microversion: 2.1 time: 0.169353 Jun 06 21:08:32.300047 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 248/500] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:32 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1443 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:32.365799 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-db134f50-b67c-4a82-a459-98bd02801afa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:32.366409 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-db134f50-b67c-4a82-a459-98bd02801afa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:32.379567 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-db134f50-b67c-4a82-a459-98bd02801afa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:32.380243 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-db134f50-b67c-4a82-a459-98bd02801afa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:32.383591 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-db134f50-b67c-4a82-a459-98bd02801afa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:32.384125 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-db134f50-b67c-4a82-a459-98bd02801afa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:32.401747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-db134f50-b67c-4a82-a459-98bd02801afa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] HTTP exception thrown: Instance 67813627-cc4f-453f-8b8f-9cec9b130583 could not be found. Jun 06 21:08:32.404399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-db134f50-b67c-4a82-a459-98bd02801afa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Request method failure captured: Jun 06 21:08:32.404399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 HTTP/1.1 Jun 06 21:08:32.404399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:08:32.404399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:08:32.404399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:08:32.404399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:08:32.404399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:08:32.404399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:08:32.404399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:08:32.404399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:08:32.404399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinmvxW1bVEWZVhCRlgeG6PDmaOvHpznA6mf68h7fAFngISNh4GnD9XFqvo52ymtA4PTaTSN-lCxDTYk7dFVIPU5elkSuX6Hf8rm-_SR1iR7N3wUEkc6KR6wmwlcMFMA3l3v8mmff7I1soQTiyS_qgppqz32gWX7gOKmiYav_WF1YU4TA Jun 06 21:08:32.404399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:08:32.404399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:08:32.404399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:08:32.404399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:08:32.404399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:08:32.404399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:08:32.404399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:08:32.404399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:08:32.404399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:08:32.404399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:08:32.406314 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:08:32.406314 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:08:32.406314 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:08:32.406314 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:08:32.406314 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:08:32.406314 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:08:32.406314 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:08:32.406314 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: 8713cb23a93147f8b52f88e240c81d6f Jun 06 21:08:32.406314 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:08:32.406314 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: > Jun 06 21:08:32.406314 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Instance 67813627-cc4f-453f-8b8f-9cec9b130583 could not be found. Jun 06 21:08:32.406314 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '67813627-cc4f-453f-8b8f-9cec9b130583'} Jun 06 21:08:32.407506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:08:32.407506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:08:32.407506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:08:32.407506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:08:32.407506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:08:32.407506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:08:32.407506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:08:32.407506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:08:32.407506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:08:32.407506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:08:32.407506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67813627-cc4f-453f-8b8f-9cec9b130583 could not be found. Jun 06 21:08:32.407506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:08:32.407506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:08:32.407506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:08:32.407506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:08:32.407506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:08:32.407506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:08:32.407506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:08:32.407506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:08:32.407506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:08:32.410071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:08:32.410071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:08:32.410071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:08:32.410071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:08:32.410071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:08:32.410071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:08:32.410071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:08:32.410071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67813627-cc4f-453f-8b8f-9cec9b130583 could not be found. Jun 06 21:08:32.410071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:08:32.410071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:08:32.410071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:08:32.410071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:08:32.410071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:08:32.410071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:08:32.410071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:08:32.410071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:08:32.410071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67813627-cc4f-453f-8b8f-9cec9b130583 could not be found. Jun 06 21:08:32.410071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:08:32.412298 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-db134f50-b67c-4a82-a459-98bd02801afa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Returning 404 to user: Instance 67813627-cc4f-453f-8b8f-9cec9b130583 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:08:32.412298 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-db134f50-b67c-4a82-a459-98bd02801afa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 404 len: 111 microversion: 2.1 time: 0.044282 Jun 06 21:08:32.412298 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 253/501] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:32 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:08:32.416281 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-919bf520-489d-4561-a14a-e6496cb74a67 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '.version_select at 0x7f272602b820>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:32.440415 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-919bf520-489d-4561-a14a-e6496cb74a67 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1875207055" status: 202 len: 0 microversion: 2.1 time: 0.028512 Jun 06 21:08:32.441007 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 249/502] 10.222.0.33 () {58 vars in 1220 bytes} [Mon Jun 6 21:08:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1875207055 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:08:32.739406 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d868cbca-aa54-48e1-a3a3-bf043c799de1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:32.740323 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d868cbca-aa54-48e1-a3a3-bf043c799de1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:32.752321 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d868cbca-aa54-48e1-a3a3-bf043c799de1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:32.753461 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d868cbca-aa54-48e1-a3a3-bf043c799de1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:32.754815 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d868cbca-aa54-48e1-a3a3-bf043c799de1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:32.755596 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d868cbca-aa54-48e1-a3a3-bf043c799de1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:32.851138 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d868cbca-aa54-48e1-a3a3-bf043c799de1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:32.872096 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d868cbca-aa54-48e1-a3a3-bf043c799de1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1297 microversion: 2.1 time: 0.135701 Jun 06 21:08:32.878893 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 254/503] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:32 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1297 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:33.498366 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-1574ee0c-655a-43f1-80c3-9d9e204c8826 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Action: 'create', calling method: .version_select at 0x7f2725f64280>, body: {"keypair": {"name": "tempest-keypair-859659914", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEPnTtWibbw4CKJzuShkmztSalm/UJfwIKL6e8yyMgPBjCmvkqeWcnrkW63DX3pG161bd6fWCzyrMDVDlk8pjqYFBdd3kKVOHHPhzmL3ZMkWjxcL24CTSkdWP4DH/mGHmg=="}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:33.528322 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-1574ee0c-655a-43f1-80c3-9d9e204c8826 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Getting quotas for project 5a771f1ab27f40aca2d546901cdcecda. Resources: {'key_pairs'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:08:33.533831 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-1574ee0c-655a-43f1-80c3-9d9e204c8826 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Getting quotas for user 8713cb23a93147f8b52f88e240c81d6f and project 5a771f1ab27f40aca2d546901cdcecda. Resources: {'key_pairs'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:08:33.567132 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-1574ee0c-655a-43f1-80c3-9d9e204c8826 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.075943 Jun 06 21:08:33.573762 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 250/504] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jun 6 21:08:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:08:33.902560 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0a279071-9938-4ce4-9ad6-52b7a704836b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:33.903345 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0a279071-9938-4ce4-9ad6-52b7a704836b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:33.914871 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a279071-9938-4ce4-9ad6-52b7a704836b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:33.915978 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a279071-9938-4ce4-9ad6-52b7a704836b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:33.919087 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a279071-9938-4ce4-9ad6-52b7a704836b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:33.919744 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0a279071-9938-4ce4-9ad6-52b7a704836b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:34.020248 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0a279071-9938-4ce4-9ad6-52b7a704836b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:34.029895 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0a279071-9938-4ce4-9ad6-52b7a704836b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1303 microversion: 2.1 time: 0.133754 Jun 06 21:08:34.030755 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 255/505] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:33 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1303 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:34.653667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-e84cbfd7-bbda-4e49-a97d-a10e3e1a67f9 req-93c457d2-5afe-4fb0-b82a-51333cb14b1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807baad3-4d23-4d63-b4a9-7163fc77e302", "tag": "98717e19-2897-4922-9eb5-8ca664fad7a8"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:34.669782 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-e84cbfd7-bbda-4e49-a97d-a10e3e1a67f9 req-93c457d2-5afe-4fb0-b82a-51333cb14b1a service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:34.671393 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-e84cbfd7-bbda-4e49-a97d-a10e3e1a67f9 req-93c457d2-5afe-4fb0-b82a-51333cb14b1a service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:34.687912 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-e84cbfd7-bbda-4e49-a97d-a10e3e1a67f9 req-93c457d2-5afe-4fb0-b82a-51333cb14b1a service nova] Creating event network-changed:98717e19-2897-4922-9eb5-8ca664fad7a8 for instance 807baad3-4d23-4d63-b4a9-7163fc77e302 on hv-cinder-84488 Jun 06 21:08:34.695857 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-e84cbfd7-bbda-4e49-a97d-a10e3e1a67f9 req-93c457d2-5afe-4fb0-b82a-51333cb14b1a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050745 Jun 06 21:08:34.696832 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 251/506] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:08:35.053786 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b1273716-34ce-4c7c-bbf6-865564b9cfeb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:35.054823 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b1273716-34ce-4c7c-bbf6-865564b9cfeb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:35.078302 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b1273716-34ce-4c7c-bbf6-865564b9cfeb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:35.079111 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b1273716-34ce-4c7c-bbf6-865564b9cfeb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:35.080481 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b1273716-34ce-4c7c-bbf6-865564b9cfeb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:35.081110 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b1273716-34ce-4c7c-bbf6-865564b9cfeb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:35.248772 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-0060e0fe-32ab-4803-bba8-74d3c0979782 req-c99a83a4-a65a-4452-af10-650f4eae6d32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1", "tag": "bde81077-0263-4b2a-91eb-97a7fd73212f"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:35.265846 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-0060e0fe-32ab-4803-bba8-74d3c0979782 req-c99a83a4-a65a-4452-af10-650f4eae6d32 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:35.269127 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-0060e0fe-32ab-4803-bba8-74d3c0979782 req-c99a83a4-a65a-4452-af10-650f4eae6d32 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:35.298684 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-0060e0fe-32ab-4803-bba8-74d3c0979782 req-c99a83a4-a65a-4452-af10-650f4eae6d32 service nova] Creating event network-changed:bde81077-0263-4b2a-91eb-97a7fd73212f for instance a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 on hv-cinder-84488 Jun 06 21:08:35.306439 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-0060e0fe-32ab-4803-bba8-74d3c0979782 req-c99a83a4-a65a-4452-af10-650f4eae6d32 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064198 Jun 06 21:08:35.307863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 252/507] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:08:35.409437 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b1273716-34ce-4c7c-bbf6-865564b9cfeb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:35.430561 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b1273716-34ce-4c7c-bbf6-865564b9cfeb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1371 microversion: 2.1 time: 0.382998 Jun 06 21:08:35.442017 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 256/508] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:35 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1371 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:36.450205 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-bbf3b1e2-6b9b-4af4-a3c2-e72fb48d83ce tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:36.451089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-bbf3b1e2-6b9b-4af4-a3c2-e72fb48d83ce tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:36.457842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bbf3b1e2-6b9b-4af4-a3c2-e72fb48d83ce tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:36.458290 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bbf3b1e2-6b9b-4af4-a3c2-e72fb48d83ce tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:36.459142 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bbf3b1e2-6b9b-4af4-a3c2-e72fb48d83ce tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:36.459573 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bbf3b1e2-6b9b-4af4-a3c2-e72fb48d83ce tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:36.517778 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-86fb4e65-e5f0-4a6d-aeb3-e8d94a3bd68d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-701010035", "imageRef": "e4266a01-7d22-4036-91e8-3ec50e3369c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "caa56bb2-4a47-4aeb-99db-1e89b9e32e70"}], "security_groups": [{"name": "tempest-securitygroup--1367284174"}], "key_name": "tempest-keypair-859659914", "user_data": "}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:36.612254 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-bbf3b1e2-6b9b-4af4-a3c2-e72fb48d83ce tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:36.621813 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-bbf3b1e2-6b9b-4af4-a3c2-e72fb48d83ce tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1371 microversion: 2.1 time: 0.176469 Jun 06 21:08:36.625857 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 253/509] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:36 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:36.646079 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-86fb4e65-e5f0-4a6d-aeb3-e8d94a3bd68d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] validate_networks() for [('caa56bb2-4a47-4aeb-99db-1e89b9e32e70', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 21:08:37.113623 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-86fb4e65-e5f0-4a6d-aeb3-e8d94a3bd68d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 21:08:37.114039 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-86fb4e65-e5f0-4a6d-aeb3-e8d94a3bd68d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 21:08:37.114753 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-86fb4e65-e5f0-4a6d-aeb3-e8d94a3bd68d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 21:08:37.115162 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-86fb4e65-e5f0-4a6d-aeb3-e8d94a3bd68d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 21:08:37.115641 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-86fb4e65-e5f0-4a6d-aeb3-e8d94a3bd68d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 21:08:37.125809 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86fb4e65-e5f0-4a6d-aeb3-e8d94a3bd68d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:37.126588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86fb4e65-e5f0-4a6d-aeb3-e8d94a3bd68d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:37.127389 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86fb4e65-e5f0-4a6d-aeb3-e8d94a3bd68d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:37.127814 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86fb4e65-e5f0-4a6d-aeb3-e8d94a3bd68d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:37.146283 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-86fb4e65-e5f0-4a6d-aeb3-e8d94a3bd68d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Getting quotas for project 5a771f1ab27f40aca2d546901cdcecda. Resources: {'ram', 'cores', 'instances'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:08:37.150813 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-86fb4e65-e5f0-4a6d-aeb3-e8d94a3bd68d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Getting quotas for user 8713cb23a93147f8b52f88e240c81d6f and project 5a771f1ab27f40aca2d546901cdcecda. Resources: {'ram', 'cores', 'instances'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:08:37.162614 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-86fb4e65-e5f0-4a6d-aeb3-e8d94a3bd68d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 21:08:37.164841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-86fb4e65-e5f0-4a6d-aeb3-e8d94a3bd68d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4266a01-7d22-4036-91e8-3ec50e3369c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 21:08:37.220391 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-86fb4e65-e5f0-4a6d-aeb3-e8d94a3bd68d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.706847 Jun 06 21:08:37.226685 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 257/510] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 6 21:08:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 21:08:37.232475 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0eca2495-32b8-4ee7-98a5-cee7d98f47ff tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:37.233094 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-0eca2495-32b8-4ee7-98a5-cee7d98f47ff tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:37.323281 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-0eca2495-32b8-4ee7-98a5-cee7d98f47ff tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:37.331456 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-0eca2495-32b8-4ee7-98a5-cee7d98f47ff tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d" status: 200 len: 1240 microversion: 2.1 time: 0.103272 Jun 06 21:08:37.332342 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 254/511] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:37 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d => generated 1240 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:37.642542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c0a64b50-79d8-4e3d-b29e-4381e2963f69 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:37.643479 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c0a64b50-79d8-4e3d-b29e-4381e2963f69 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:37.656186 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c0a64b50-79d8-4e3d-b29e-4381e2963f69 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:37.656929 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c0a64b50-79d8-4e3d-b29e-4381e2963f69 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:37.658242 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c0a64b50-79d8-4e3d-b29e-4381e2963f69 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:37.659029 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c0a64b50-79d8-4e3d-b29e-4381e2963f69 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:37.817958 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c0a64b50-79d8-4e3d-b29e-4381e2963f69 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:37.826372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c0a64b50-79d8-4e3d-b29e-4381e2963f69 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1371 microversion: 2.1 time: 0.190396 Jun 06 21:08:37.827238 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 258/512] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:37 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:38.352501 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-d152f1b0-f4b6-4aa6-b0f6-e8826406a3da tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:38.353912 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-d152f1b0-f4b6-4aa6-b0f6-e8826406a3da tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:38.380716 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d152f1b0-f4b6-4aa6-b0f6-e8826406a3da tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:38.381310 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d152f1b0-f4b6-4aa6-b0f6-e8826406a3da tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:38.382148 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d152f1b0-f4b6-4aa6-b0f6-e8826406a3da tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:38.382580 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d152f1b0-f4b6-4aa6-b0f6-e8826406a3da tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:38.498242 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-d152f1b0-f4b6-4aa6-b0f6-e8826406a3da tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:38.506839 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-d152f1b0-f4b6-4aa6-b0f6-e8826406a3da tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d" status: 200 len: 1300 microversion: 2.1 time: 0.161549 Jun 06 21:08:38.507912 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 255/513] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:38 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d => generated 1300 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:38.845958 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2fac2d47-a7f2-4406-bbc3-d426a9575dd7 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:38.848310 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2fac2d47-a7f2-4406-bbc3-d426a9575dd7 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:38.856445 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2fac2d47-a7f2-4406-bbc3-d426a9575dd7 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:38.856953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2fac2d47-a7f2-4406-bbc3-d426a9575dd7 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:38.857724 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2fac2d47-a7f2-4406-bbc3-d426a9575dd7 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:38.858153 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2fac2d47-a7f2-4406-bbc3-d426a9575dd7 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:39.014741 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2fac2d47-a7f2-4406-bbc3-d426a9575dd7 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:39.024615 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2fac2d47-a7f2-4406-bbc3-d426a9575dd7 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1371 microversion: 2.1 time: 0.182937 Jun 06 21:08:39.026886 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 259/514] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:38 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:08:39.525648 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-1c724a49-e288-4d5d-87df-a4874051b68a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:39.526934 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-1c724a49-e288-4d5d-87df-a4874051b68a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:39.534496 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1c724a49-e288-4d5d-87df-a4874051b68a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:39.534912 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1c724a49-e288-4d5d-87df-a4874051b68a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:39.536740 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1c724a49-e288-4d5d-87df-a4874051b68a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:39.537176 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1c724a49-e288-4d5d-87df-a4874051b68a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:39.814232 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-1c724a49-e288-4d5d-87df-a4874051b68a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:39.822402 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-1c724a49-e288-4d5d-87df-a4874051b68a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d" status: 200 len: 1366 microversion: 2.1 time: 0.301161 Jun 06 21:08:39.822990 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 256/515] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:39 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:40.045797 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2e4299ab-2794-40ff-b2f1-13f552a72bf3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:40.046606 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2e4299ab-2794-40ff-b2f1-13f552a72bf3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:40.054161 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e4299ab-2794-40ff-b2f1-13f552a72bf3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:40.054544 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e4299ab-2794-40ff-b2f1-13f552a72bf3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:40.056936 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e4299ab-2794-40ff-b2f1-13f552a72bf3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:40.057758 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e4299ab-2794-40ff-b2f1-13f552a72bf3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:40.210841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2e4299ab-2794-40ff-b2f1-13f552a72bf3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:40.221260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2e4299ab-2794-40ff-b2f1-13f552a72bf3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1371 microversion: 2.1 time: 0.181045 Jun 06 21:08:40.222704 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 260/516] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:40 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1371 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:40.274614 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-b59f43a4-707f-42b6-9c1d-f9bf45a31b01 req-2b161cd5-116d-4fcd-882c-c42314907744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fe2313a-d12a-432f-b5b2-4f410f89682d", "tag": "944d7702-0db4-4e86-9b81-2f64060ac6be"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:40.284399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-b59f43a4-707f-42b6-9c1d-f9bf45a31b01 req-2b161cd5-116d-4fcd-882c-c42314907744 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:40.284840 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-b59f43a4-707f-42b6-9c1d-f9bf45a31b01 req-2b161cd5-116d-4fcd-882c-c42314907744 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:40.297909 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-b59f43a4-707f-42b6-9c1d-f9bf45a31b01 req-2b161cd5-116d-4fcd-882c-c42314907744 service nova] Creating event network-changed:944d7702-0db4-4e86-9b81-2f64060ac6be for instance 9fe2313a-d12a-432f-b5b2-4f410f89682d on hv-cinder-84488 Jun 06 21:08:40.304411 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-b59f43a4-707f-42b6-9c1d-f9bf45a31b01 req-2b161cd5-116d-4fcd-882c-c42314907744 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036041 Jun 06 21:08:40.305336 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 257/517] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:08:40.580758 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-e7066c57-26cc-4b01-a94b-c8e47896ea1e req-7184777c-3cf0-4dca-80e6-8c67a1f4d327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1", "name": "network-vif-plugged", "status": "completed", "tag": "bde81077-0263-4b2a-91eb-97a7fd73212f"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:40.590131 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-e7066c57-26cc-4b01-a94b-c8e47896ea1e req-7184777c-3cf0-4dca-80e6-8c67a1f4d327 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:40.590734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-e7066c57-26cc-4b01-a94b-c8e47896ea1e req-7184777c-3cf0-4dca-80e6-8c67a1f4d327 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:40.604540 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-e7066c57-26cc-4b01-a94b-c8e47896ea1e req-7184777c-3cf0-4dca-80e6-8c67a1f4d327 service nova] Creating event network-vif-plugged:bde81077-0263-4b2a-91eb-97a7fd73212f for instance a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 on hv-cinder-84488 Jun 06 21:08:40.609844 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-e7066c57-26cc-4b01-a94b-c8e47896ea1e req-7184777c-3cf0-4dca-80e6-8c67a1f4d327 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033343 Jun 06 21:08:40.610454 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 261/518] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:08:40.841624 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e88dbefc-28b3-4a5d-b891-ad4d2bb1799a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:40.842297 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-e88dbefc-28b3-4a5d-b891-ad4d2bb1799a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:40.849031 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e88dbefc-28b3-4a5d-b891-ad4d2bb1799a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:40.849533 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e88dbefc-28b3-4a5d-b891-ad4d2bb1799a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:40.850274 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e88dbefc-28b3-4a5d-b891-ad4d2bb1799a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:40.850694 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e88dbefc-28b3-4a5d-b891-ad4d2bb1799a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:40.989381 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e88dbefc-28b3-4a5d-b891-ad4d2bb1799a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:40.997229 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-e88dbefc-28b3-4a5d-b891-ad4d2bb1799a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d" status: 200 len: 1366 microversion: 2.1 time: 0.160381 Jun 06 21:08:40.997815 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 258/519] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:40 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:41.240904 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-65bc706a-08d2-4295-852c-436b8f9d6d75 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:41.241594 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-65bc706a-08d2-4295-852c-436b8f9d6d75 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:41.250158 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65bc706a-08d2-4295-852c-436b8f9d6d75 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:41.250612 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65bc706a-08d2-4295-852c-436b8f9d6d75 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:41.251385 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65bc706a-08d2-4295-852c-436b8f9d6d75 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:41.251810 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-65bc706a-08d2-4295-852c-436b8f9d6d75 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:41.396352 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-65bc706a-08d2-4295-852c-436b8f9d6d75 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:41.405331 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-65bc706a-08d2-4295-852c-436b8f9d6d75 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1371 microversion: 2.1 time: 0.169097 Jun 06 21:08:41.405930 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 262/520] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:41 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:42.014380 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-300df102-b967-4ba3-995c-d49587208536 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:42.015031 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-300df102-b967-4ba3-995c-d49587208536 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:42.022240 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-300df102-b967-4ba3-995c-d49587208536 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:42.022685 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-300df102-b967-4ba3-995c-d49587208536 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:42.023441 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-300df102-b967-4ba3-995c-d49587208536 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:42.023857 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-300df102-b967-4ba3-995c-d49587208536 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:42.026764 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=100 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:42.166767 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-300df102-b967-4ba3-995c-d49587208536 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:42.174280 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-300df102-b967-4ba3-995c-d49587208536 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d" status: 200 len: 1366 microversion: 2.1 time: 0.164054 Jun 06 21:08:42.174830 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 259/521] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:42 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:42.425950 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-43be5b56-05bb-474d-b0b5-0dc76c2b5eaa tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:42.426534 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-43be5b56-05bb-474d-b0b5-0dc76c2b5eaa tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:42.434800 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-43be5b56-05bb-474d-b0b5-0dc76c2b5eaa tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:42.435192 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-43be5b56-05bb-474d-b0b5-0dc76c2b5eaa tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:42.435974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-43be5b56-05bb-474d-b0b5-0dc76c2b5eaa tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:42.436427 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-43be5b56-05bb-474d-b0b5-0dc76c2b5eaa tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:42.601438 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-43be5b56-05bb-474d-b0b5-0dc76c2b5eaa tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:42.609411 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-43be5b56-05bb-474d-b0b5-0dc76c2b5eaa tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1371 microversion: 2.1 time: 0.187483 Jun 06 21:08:42.609906 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 263/522] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:42 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1371 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:43.191157 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-c323ddb3-b37d-4f09-a344-e31bc3aa1b71 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:43.191761 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-c323ddb3-b37d-4f09-a344-e31bc3aa1b71 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:43.199890 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c323ddb3-b37d-4f09-a344-e31bc3aa1b71 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:43.200503 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c323ddb3-b37d-4f09-a344-e31bc3aa1b71 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:43.201283 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c323ddb3-b37d-4f09-a344-e31bc3aa1b71 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:43.201824 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c323ddb3-b37d-4f09-a344-e31bc3aa1b71 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:43.340455 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c323ddb3-b37d-4f09-a344-e31bc3aa1b71 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:43.348539 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-c323ddb3-b37d-4f09-a344-e31bc3aa1b71 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d" status: 200 len: 1366 microversion: 2.1 time: 0.161298 Jun 06 21:08:43.349187 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 260/523] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:43 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:43.626966 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e662cc20-7630-4ab9-a328-62c50a3f8786 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:43.627767 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e662cc20-7630-4ab9-a328-62c50a3f8786 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:43.634779 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e662cc20-7630-4ab9-a328-62c50a3f8786 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:43.635206 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e662cc20-7630-4ab9-a328-62c50a3f8786 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:43.635978 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e662cc20-7630-4ab9-a328-62c50a3f8786 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:43.636442 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e662cc20-7630-4ab9-a328-62c50a3f8786 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:43.813063 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e662cc20-7630-4ab9-a328-62c50a3f8786 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:43.824024 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e662cc20-7630-4ab9-a328-62c50a3f8786 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1371 microversion: 2.1 time: 0.201031 Jun 06 21:08:43.824780 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 264/524] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:43 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:44.366016 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-058e6dcd-8c93-46b8-baf0-787099ae3211 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:44.366700 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-058e6dcd-8c93-46b8-baf0-787099ae3211 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:44.374235 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-058e6dcd-8c93-46b8-baf0-787099ae3211 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:44.374688 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-058e6dcd-8c93-46b8-baf0-787099ae3211 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:44.375437 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-058e6dcd-8c93-46b8-baf0-787099ae3211 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:44.375894 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-058e6dcd-8c93-46b8-baf0-787099ae3211 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:44.511527 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-058e6dcd-8c93-46b8-baf0-787099ae3211 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:44.519369 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-058e6dcd-8c93-46b8-baf0-787099ae3211 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d" status: 200 len: 1366 microversion: 2.1 time: 0.157211 Jun 06 21:08:44.520183 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 261/525] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:44 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:44.841890 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-320830f8-6a61-46b9-8be4-bface9ee2ae2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:44.842486 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-320830f8-6a61-46b9-8be4-bface9ee2ae2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:44.849993 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-320830f8-6a61-46b9-8be4-bface9ee2ae2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:44.850422 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-320830f8-6a61-46b9-8be4-bface9ee2ae2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:44.851495 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-320830f8-6a61-46b9-8be4-bface9ee2ae2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:44.852051 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-320830f8-6a61-46b9-8be4-bface9ee2ae2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:45.243644 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-320830f8-6a61-46b9-8be4-bface9ee2ae2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:45.255093 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-320830f8-6a61-46b9-8be4-bface9ee2ae2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1564 microversion: 2.1 time: 0.417464 Jun 06 21:08:45.255665 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 265/526] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:44 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1564 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:45.273946 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-df4bf4f9-f2fc-4961-96fb-e5381b9a3540 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:45.274518 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-df4bf4f9-f2fc-4961-96fb-e5381b9a3540 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:45.281293 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-df4bf4f9-f2fc-4961-96fb-e5381b9a3540 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:45.281733 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-df4bf4f9-f2fc-4961-96fb-e5381b9a3540 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:45.282640 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-df4bf4f9-f2fc-4961-96fb-e5381b9a3540 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:45.283182 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-df4bf4f9-f2fc-4961-96fb-e5381b9a3540 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:45.369030 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-df4bf4f9-f2fc-4961-96fb-e5381b9a3540 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100391 Jun 06 21:08:45.369641 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 262/527] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jun 6 21:08:45 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:08:45.383915 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ff07e68e-db63-4f0c-982b-2b2e4b00a729 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09f47671-39c5-409d-a47f-17a4e965c897", "device": "/dev/sdb"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:45.385540 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ff07e68e-db63-4f0c-982b-2b2e4b00a729 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:45.391932 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ff07e68e-db63-4f0c-982b-2b2e4b00a729 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:45.392422 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ff07e68e-db63-4f0c-982b-2b2e4b00a729 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:45.393264 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ff07e68e-db63-4f0c-982b-2b2e4b00a729 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:45.393628 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ff07e68e-db63-4f0c-982b-2b2e4b00a729 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:45.538308 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-f98bf5bd-ca6e-48f3-9d97-8ac1752ef2e2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:45.538999 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-f98bf5bd-ca6e-48f3-9d97-8ac1752ef2e2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:45.546173 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f98bf5bd-ca6e-48f3-9d97-8ac1752ef2e2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:45.546929 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f98bf5bd-ca6e-48f3-9d97-8ac1752ef2e2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:45.547817 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f98bf5bd-ca6e-48f3-9d97-8ac1752ef2e2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:45.548272 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f98bf5bd-ca6e-48f3-9d97-8ac1752ef2e2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:45.687733 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ff07e68e-db63-4f0c-982b-2b2e4b00a729 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "POST /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307691 Jun 06 21:08:45.693246 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 266/528] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 6 21:08:45 2022] POST /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:08:45.712349 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-f98bf5bd-ca6e-48f3-9d97-8ac1752ef2e2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:45.721277 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-f98bf5bd-ca6e-48f3-9d97-8ac1752ef2e2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d" status: 200 len: 1366 microversion: 2.1 time: 0.188411 Jun 06 21:08:45.721873 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 263/529] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:45 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:46.409267 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-0448a286-d106-4911-8c69-8ebe635de5f6 req-5d543b77-df00-490a-bc13-b59a11ef3c88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1", "tag": "bde81077-0263-4b2a-91eb-97a7fd73212f"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:46.417998 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-0448a286-d106-4911-8c69-8ebe635de5f6 req-5d543b77-df00-490a-bc13-b59a11ef3c88 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:46.418698 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-0448a286-d106-4911-8c69-8ebe635de5f6 req-5d543b77-df00-490a-bc13-b59a11ef3c88 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:46.433463 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-0448a286-d106-4911-8c69-8ebe635de5f6 req-5d543b77-df00-490a-bc13-b59a11ef3c88 service nova] Creating event network-changed:bde81077-0263-4b2a-91eb-97a7fd73212f for instance a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 on hv-cinder-84488 Jun 06 21:08:46.439095 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-0448a286-d106-4911-8c69-8ebe635de5f6 req-5d543b77-df00-490a-bc13-b59a11ef3c88 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034591 Jun 06 21:08:46.439821 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 267/530] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:08:46.700477 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-d4c34a6e-88cb-404f-aff7-973d75e82a33 req-98c89dd2-828e-453f-9ab3-10ee43d79bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fe2313a-d12a-432f-b5b2-4f410f89682d", "name": "network-vif-plugged", "status": "completed", "tag": "944d7702-0db4-4e86-9b81-2f64060ac6be"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:46.710526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-d4c34a6e-88cb-404f-aff7-973d75e82a33 req-98c89dd2-828e-453f-9ab3-10ee43d79bd9 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:46.710977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-d4c34a6e-88cb-404f-aff7-973d75e82a33 req-98c89dd2-828e-453f-9ab3-10ee43d79bd9 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:46.725401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-d4c34a6e-88cb-404f-aff7-973d75e82a33 req-98c89dd2-828e-453f-9ab3-10ee43d79bd9 service nova] Creating event network-vif-plugged:944d7702-0db4-4e86-9b81-2f64060ac6be for instance 9fe2313a-d12a-432f-b5b2-4f410f89682d on hv-cinder-84488 Jun 06 21:08:46.731196 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-d4c34a6e-88cb-404f-aff7-973d75e82a33 req-98c89dd2-828e-453f-9ab3-10ee43d79bd9 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034960 Jun 06 21:08:46.732306 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 264/531] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:08:46.740647 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c696370d-3b1b-4aa9-af79-315cef4d6d3b tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:46.742308 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c696370d-3b1b-4aa9-af79-315cef4d6d3b tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:46.750141 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c696370d-3b1b-4aa9-af79-315cef4d6d3b tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:46.750979 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c696370d-3b1b-4aa9-af79-315cef4d6d3b tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:46.751949 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c696370d-3b1b-4aa9-af79-315cef4d6d3b tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:46.752636 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c696370d-3b1b-4aa9-af79-315cef4d6d3b tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:47.029922 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c696370d-3b1b-4aa9-af79-315cef4d6d3b tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:47.037954 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c696370d-3b1b-4aa9-af79-315cef4d6d3b tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d" status: 200 len: 1366 microversion: 2.1 time: 0.302141 Jun 06 21:08:47.038530 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 268/532] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:46 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d => generated 1366 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:48.052265 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=8 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:48.056863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-f9265a8f-0abd-4ec5-89b3-3a4efdbebc7c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:48.057573 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-f9265a8f-0abd-4ec5-89b3-3a4efdbebc7c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:48.064643 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f9265a8f-0abd-4ec5-89b3-3a4efdbebc7c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:48.065000 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f9265a8f-0abd-4ec5-89b3-3a4efdbebc7c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:48.065757 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f9265a8f-0abd-4ec5-89b3-3a4efdbebc7c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:48.066179 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f9265a8f-0abd-4ec5-89b3-3a4efdbebc7c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:48.201502 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-f9265a8f-0abd-4ec5-89b3-3a4efdbebc7c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:48.209505 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-f9265a8f-0abd-4ec5-89b3-3a4efdbebc7c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d" status: 200 len: 1366 microversion: 2.1 time: 0.158244 Jun 06 21:08:48.210076 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 265/533] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:48 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:49.226790 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-aeed2e49-208b-4744-9730-2de375655809 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:49.227410 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-aeed2e49-208b-4744-9730-2de375655809 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:49.229496 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=4 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:49.230133 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=16 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:49.239759 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aeed2e49-208b-4744-9730-2de375655809 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:49.240201 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aeed2e49-208b-4744-9730-2de375655809 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:49.241922 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aeed2e49-208b-4744-9730-2de375655809 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:49.242698 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aeed2e49-208b-4744-9730-2de375655809 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:49.259108 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:08:49.386886 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-aeed2e49-208b-4744-9730-2de375655809 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:49.395908 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-aeed2e49-208b-4744-9730-2de375655809 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d" status: 200 len: 1366 microversion: 2.1 time: 0.172832 Jun 06 21:08:49.396582 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 269/534] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:49 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:50.413357 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-47e120e1-4429-44fe-b446-5b3d148e2bdf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:50.413966 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-47e120e1-4429-44fe-b446-5b3d148e2bdf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:50.421085 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-47e120e1-4429-44fe-b446-5b3d148e2bdf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:50.421622 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-47e120e1-4429-44fe-b446-5b3d148e2bdf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:50.422402 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-47e120e1-4429-44fe-b446-5b3d148e2bdf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:50.422837 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-47e120e1-4429-44fe-b446-5b3d148e2bdf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:50.565314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-47e120e1-4429-44fe-b446-5b3d148e2bdf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:08:50.573385 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-47e120e1-4429-44fe-b446-5b3d148e2bdf tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d" status: 200 len: 1556 microversion: 2.1 time: 0.163948 Jun 06 21:08:50.573959 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 266/535] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:08:50 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d => generated 1556 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:08:50.591128 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d8fc3952-8256-4595-a6ec-f4f9527d9907 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:08:50.591782 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d8fc3952-8256-4595-a6ec-f4f9527d9907 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:08:50.598487 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8fc3952-8256-4595-a6ec-f4f9527d9907 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:50.598936 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8fc3952-8256-4595-a6ec-f4f9527d9907 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:50.599697 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8fc3952-8256-4595-a6ec-f4f9527d9907 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:50.600159 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8fc3952-8256-4595-a6ec-f4f9527d9907 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:50.687938 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d8fc3952-8256-4595-a6ec-f4f9527d9907 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100092 Jun 06 21:08:50.688581 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 270/536] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jun 6 21:08:50 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:08:51.742989 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-2aa8aa0f-0685-4463-aac7-4e21e93c8169 req-b19533bf-a77e-476d-a133-c5423bfda3cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9fe2313a-d12a-432f-b5b2-4f410f89682d", "tag": "944d7702-0db4-4e86-9b81-2f64060ac6be"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:08:51.752385 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-2aa8aa0f-0685-4463-aac7-4e21e93c8169 req-b19533bf-a77e-476d-a133-c5423bfda3cd service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:08:51.752898 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-2aa8aa0f-0685-4463-aac7-4e21e93c8169 req-b19533bf-a77e-476d-a133-c5423bfda3cd service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:08:51.764861 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-2aa8aa0f-0685-4463-aac7-4e21e93c8169 req-b19533bf-a77e-476d-a133-c5423bfda3cd service nova] Creating event network-changed:944d7702-0db4-4e86-9b81-2f64060ac6be for instance 9fe2313a-d12a-432f-b5b2-4f410f89682d on hv-cinder-84488 Jun 06 21:08:51.770521 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-2aa8aa0f-0685-4463-aac7-4e21e93c8169 req-b19533bf-a77e-476d-a133-c5423bfda3cd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032054 Jun 06 21:08:51.771261 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 267/537] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:09:09.581672 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:09:09.582434 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=7 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:09:09.586632 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2fdc72cc-079e-4c4b-81d6-9e7356557f89 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:09.587132 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2fdc72cc-079e-4c4b-81d6-9e7356557f89 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:09.594667 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2fdc72cc-079e-4c4b-81d6-9e7356557f89 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:09.595115 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2fdc72cc-079e-4c4b-81d6-9e7356557f89 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:09.595867 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2fdc72cc-079e-4c4b-81d6-9e7356557f89 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:09.596585 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2fdc72cc-079e-4c4b-81d6-9e7356557f89 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:09.685098 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-2fdc72cc-079e-4c4b-81d6-9e7356557f89 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lazy-loading 'services' on Instance uuid 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:09:09.765496 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2fdc72cc-079e-4c4b-81d6-9e7356557f89 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5/os-volume_attachments/09f47671-39c5-409d-a47f-17a4e965c897" status: 202 len: 0 microversion: 2.1 time: 0.185016 Jun 06 21:09:09.766611 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 271/538] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 6 21:09:09 2022] DELETE /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5/os-volume_attachments/09f47671-39c5-409d-a47f-17a4e965c897 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:09:10.896395 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:09:10.897253 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=43 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:09:10.901724 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-6002e748-26b9-4215-81d1-a15fbfb0a7a1 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:10.902331 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-6002e748-26b9-4215-81d1-a15fbfb0a7a1 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:10.909808 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6002e748-26b9-4215-81d1-a15fbfb0a7a1 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:10.910253 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6002e748-26b9-4215-81d1-a15fbfb0a7a1 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:10.911030 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6002e748-26b9-4215-81d1-a15fbfb0a7a1 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:10.911461 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6002e748-26b9-4215-81d1-a15fbfb0a7a1 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:10.939286 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-6002e748-26b9-4215-81d1-a15fbfb0a7a1 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Going to try to terminate instance {{(pid=117860) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 21:09:11.033716 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-6002e748-26b9-4215-81d1-a15fbfb0a7a1 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "DELETE /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 204 len: 0 microversion: 2.1 time: 0.138647 Jun 06 21:09:11.034517 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 268/539] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:09:10 2022] DELETE /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 21:09:11.046131 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a2723ca2-0fbd-4536-a9b2-0a1b4d34be45 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:11.046805 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a2723ca2-0fbd-4536-a9b2-0a1b4d34be45 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:11.055014 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a2723ca2-0fbd-4536-a9b2-0a1b4d34be45 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:11.055466 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a2723ca2-0fbd-4536-a9b2-0a1b4d34be45 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:11.056263 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a2723ca2-0fbd-4536-a9b2-0a1b4d34be45 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:11.056693 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a2723ca2-0fbd-4536-a9b2-0a1b4d34be45 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:11.196051 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a2723ca2-0fbd-4536-a9b2-0a1b4d34be45 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:11.204362 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a2723ca2-0fbd-4536-a9b2-0a1b4d34be45 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1512 microversion: 2.1 time: 0.163013 Jun 06 21:09:11.204932 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 272/540] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:09:11 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:09:12.223444 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-73b51ccf-e39c-486a-af05-27eb9d628f71 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:12.225877 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-73b51ccf-e39c-486a-af05-27eb9d628f71 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:12.232414 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-73b51ccf-e39c-486a-af05-27eb9d628f71 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:12.233057 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-73b51ccf-e39c-486a-af05-27eb9d628f71 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:12.233835 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-73b51ccf-e39c-486a-af05-27eb9d628f71 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:12.234387 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-73b51ccf-e39c-486a-af05-27eb9d628f71 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:12.377319 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-73b51ccf-e39c-486a-af05-27eb9d628f71 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:12.385337 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-73b51ccf-e39c-486a-af05-27eb9d628f71 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1512 microversion: 2.1 time: 0.166768 Jun 06 21:09:12.385910 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 269/541] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:09:12 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:09:13.402979 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b6eb3eb1-34b3-48f4-9ac7-9b6c06c8b26d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:13.403575 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b6eb3eb1-34b3-48f4-9ac7-9b6c06c8b26d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:13.413121 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b6eb3eb1-34b3-48f4-9ac7-9b6c06c8b26d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:13.413865 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b6eb3eb1-34b3-48f4-9ac7-9b6c06c8b26d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:13.415142 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b6eb3eb1-34b3-48f4-9ac7-9b6c06c8b26d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:13.415863 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b6eb3eb1-34b3-48f4-9ac7-9b6c06c8b26d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:13.628939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b6eb3eb1-34b3-48f4-9ac7-9b6c06c8b26d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:13.637341 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b6eb3eb1-34b3-48f4-9ac7-9b6c06c8b26d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 200 len: 1512 microversion: 2.1 time: 0.238208 Jun 06 21:09:13.638054 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 273/542] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:09:13 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 1512 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:09:13.795918 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-263394d3-7745-4fed-907e-ab43853c704c req-b619ebeb-9e39-4903-ba82-d05e1e1853cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b2b83bd-e8cf-4d4e-8048-20336a5d21e5", "name": "network-vif-deleted", "tag": "8ebfa5e0-f4fb-4ca5-a0c9-947b5ca291f7"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:09:13.805349 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-263394d3-7745-4fed-907e-ab43853c704c req-b619ebeb-9e39-4903-ba82-d05e1e1853cd service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:13.805781 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-263394d3-7745-4fed-907e-ab43853c704c req-b619ebeb-9e39-4903-ba82-d05e1e1853cd service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:13.819777 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-263394d3-7745-4fed-907e-ab43853c704c req-b619ebeb-9e39-4903-ba82-d05e1e1853cd service nova] Creating event network-vif-deleted:8ebfa5e0-f4fb-4ca5-a0c9-947b5ca291f7 for instance 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 on hv-cinder-84488 Jun 06 21:09:13.824859 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-263394d3-7745-4fed-907e-ab43853c704c req-b619ebeb-9e39-4903-ba82-d05e1e1853cd service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032614 Jun 06 21:09:13.825457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 270/543] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:09:14.656024 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-208ab254-e412-4c47-92b0-13a9495dcf87 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:14.656654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-208ab254-e412-4c47-92b0-13a9495dcf87 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:14.665920 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-208ab254-e412-4c47-92b0-13a9495dcf87 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:14.666680 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-208ab254-e412-4c47-92b0-13a9495dcf87 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:14.667872 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-208ab254-e412-4c47-92b0-13a9495dcf87 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:14.668547 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-208ab254-e412-4c47-92b0-13a9495dcf87 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:14.687912 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-208ab254-e412-4c47-92b0-13a9495dcf87 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] HTTP exception thrown: Instance 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 could not be found. Jun 06 21:09:14.690382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-208ab254-e412-4c47-92b0-13a9495dcf87 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Request method failure captured: Jun 06 21:09:14.690382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 HTTP/1.1 Jun 06 21:09:14.690382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:09:14.690382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:09:14.690382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:09:14.690382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:09:14.690382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:09:14.690382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:09:14.690382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:09:14.690382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:09:14.690382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinmyy1aWtcoJ2Buw9t8XeCV0TYpUa17fkw8mN2kuFY1H31PzJElEniiTaOO5kGFcmNmJe2p_YGZRGNq0lpDzTv8eb9lSnELYAOVpbLSfde_Nhvt317bUKcy0te_RR5Duv9p2XFmxDwrj7hPsWjxgy6is-mi3JMDf4wOFUNdIU_QaCDvc Jun 06 21:09:14.690382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:09:14.690382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:09:14.690382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:09:14.690382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:09:14.690382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:09:14.690382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:09:14.690382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: a00a423b890b4dc0b4410220da7cdaa8 Jun 06 21:09:14.690382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesSnapshotTestJSON-342166078 Jun 06 21:09:14.690382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:09:14.690382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:09:14.692223 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a00a423b890b4dc0b4410220da7cdaa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a00a423b890b4dc0b4410220da7cdaa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a00a423b890b4dc0b4410220da7cdaa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a00a423b890b4dc0b4410220da7cdaa8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:09:14.692223 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesSnapshotTestJSON-342166078 Jun 06 21:09:14.692223 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: a00a423b890b4dc0b4410220da7cdaa8 Jun 06 21:09:14.692223 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-342166078 Jun 06 21:09:14.692223 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesSnapshotTestJSON-342166078-project Jun 06 21:09:14.692223 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:09:14.692223 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:09:14.692223 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: 3f74038b57aa477283f7c8fabebd19be Jun 06 21:09:14.692223 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesSnapshotTestJSON-342166078-project Jun 06 21:09:14.692223 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: > Jun 06 21:09:14.692223 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Instance 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 could not be found. Jun 06 21:09:14.692223 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '2b2b83bd-e8cf-4d4e-8048-20336a5d21e5'} Jun 06 21:09:14.693537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:09:14.693537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:09:14.693537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:09:14.693537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:09:14.693537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:09:14.693537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:09:14.693537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:09:14.693537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:09:14.693537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:09:14.693537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:09:14.693537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 could not be found. Jun 06 21:09:14.693537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:09:14.693537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:09:14.693537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:09:14.693537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:09:14.693537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:09:14.693537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:09:14.693537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:09:14.693537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:09:14.693537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:09:14.695282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:09:14.695282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:09:14.695282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:09:14.695282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:09:14.695282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:09:14.695282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:09:14.695282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:09:14.695282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 could not be found. Jun 06 21:09:14.695282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:09:14.695282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:09:14.695282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:09:14.695282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:09:14.695282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:09:14.695282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:09:14.695282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:09:14.695282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:09:14.695282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 could not be found. Jun 06 21:09:14.695282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:09:14.696798 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-208ab254-e412-4c47-92b0-13a9495dcf87 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Returning 404 to user: Instance 2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:09:14.696798 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-208ab254-e412-4c47-92b0-13a9495dcf87 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5" status: 404 len: 111 microversion: 2.1 time: 0.040764 Jun 06 21:09:14.696798 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 274/544] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:09:14 2022] GET /compute/v2.1/servers/2b2b83bd-e8cf-4d4e-8048-20336a5d21e5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:09:18.650606 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-805aaab6-0f74-4ed4-a3a0-a31783077da7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:18.651336 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-805aaab6-0f74-4ed4-a3a0-a31783077da7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:18.657854 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-805aaab6-0f74-4ed4-a3a0-a31783077da7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:18.658291 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-805aaab6-0f74-4ed4-a3a0-a31783077da7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:18.659077 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-805aaab6-0f74-4ed4-a3a0-a31783077da7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:18.659512 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-805aaab6-0f74-4ed4-a3a0-a31783077da7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:18.694273 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-805aaab6-0f74-4ed4-a3a0-a31783077da7 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0/os-volume_attachments/ac26a947-f2f0-4e65-bc4a-6831ee497c1a" status: 200 len: 194 microversion: 2.20 time: 0.048539 Jun 06 21:09:18.694911 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 271/545] 10.222.0.33 () {60 vars in 1453 bytes} [Mon Jun 6 21:09:18 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0/os-volume_attachments/ac26a947-f2f0-4e65-bc4a-6831ee497c1a => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 21:09:18.781790 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2ec51502-1243-43d2-9a0a-e8e83c6d9733 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:18.782686 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2ec51502-1243-43d2-9a0a-e8e83c6d9733 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:18.789761 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2ec51502-1243-43d2-9a0a-e8e83c6d9733 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:18.790199 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2ec51502-1243-43d2-9a0a-e8e83c6d9733 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:18.790969 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2ec51502-1243-43d2-9a0a-e8e83c6d9733 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:18.791395 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2ec51502-1243-43d2-9a0a-e8e83c6d9733 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:18.888776 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-2ec51502-1243-43d2-9a0a-e8e83c6d9733 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lazy-loading 'services' on Instance uuid 1886e3bf-c735-4f91-8a2f-0bc6996982e0 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:09:18.971806 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2ec51502-1243-43d2-9a0a-e8e83c6d9733 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0/os-volume_attachments/ac26a947-f2f0-4e65-bc4a-6831ee497c1a" status: 202 len: 0 microversion: 2.20 time: 0.194103 Jun 06 21:09:18.972879 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 275/546] 10.222.0.33 () {60 vars in 1456 bytes} [Mon Jun 6 21:09:18 2022] DELETE /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0/os-volume_attachments/ac26a947-f2f0-4e65-bc4a-6831ee497c1a => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 21:09:18.987460 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-1baf048b-a898-4724-ba9f-d0182ccbc9b3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:18.989503 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-1baf048b-a898-4724-ba9f-d0182ccbc9b3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:19.000524 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1baf048b-a898-4724-ba9f-d0182ccbc9b3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:19.001315 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1baf048b-a898-4724-ba9f-d0182ccbc9b3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:19.002717 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1baf048b-a898-4724-ba9f-d0182ccbc9b3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:19.003492 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1baf048b-a898-4724-ba9f-d0182ccbc9b3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:19.068648 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-1baf048b-a898-4724-ba9f-d0182ccbc9b3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088487 Jun 06 21:09:19.070051 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 272/547] 10.222.0.33 () {60 vars in 1342 bytes} [Mon Jun 6 21:09:18 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 21:09:20.084015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-005b4fbe-e264-446c-afdf-3afe4dbc50e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:20.085187 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-005b4fbe-e264-446c-afdf-3afe4dbc50e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:20.092437 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-005b4fbe-e264-446c-afdf-3afe4dbc50e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:20.092882 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-005b4fbe-e264-446c-afdf-3afe4dbc50e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:20.093643 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-005b4fbe-e264-446c-afdf-3afe4dbc50e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:20.094071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-005b4fbe-e264-446c-afdf-3afe4dbc50e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:20.127332 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-005b4fbe-e264-446c-afdf-3afe4dbc50e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049515 Jun 06 21:09:20.127825 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 276/548] 10.222.0.33 () {60 vars in 1342 bytes} [Mon Jun 6 21:09:20 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:09:20.186982 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-39605e43-3775-4efc-9295-57043d0be450 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:20.187608 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-39605e43-3775-4efc-9295-57043d0be450 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:20.194968 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-39605e43-3775-4efc-9295-57043d0be450 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:20.195412 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-39605e43-3775-4efc-9295-57043d0be450 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:20.196204 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-39605e43-3775-4efc-9295-57043d0be450 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:20.196628 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-39605e43-3775-4efc-9295-57043d0be450 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:20.226835 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-39605e43-3775-4efc-9295-57043d0be450 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Going to try to terminate instance {{(pid=117860) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 21:09:20.317739 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-39605e43-3775-4efc-9295-57043d0be450 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 204 len: 0 microversion: 2.20 time: 0.134432 Jun 06 21:09:20.318408 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 273/549] 10.222.0.33 () {60 vars in 1279 bytes} [Mon Jun 6 21:09:20 2022] DELETE /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 06 21:09:20.328040 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e2c010fd-de1c-43bc-8aca-476947519f81 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:20.328040 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e2c010fd-de1c-43bc-8aca-476947519f81 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:20.335106 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2c010fd-de1c-43bc-8aca-476947519f81 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:20.335603 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2c010fd-de1c-43bc-8aca-476947519f81 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:20.336471 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2c010fd-de1c-43bc-8aca-476947519f81 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:20.336907 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e2c010fd-de1c-43bc-8aca-476947519f81 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:20.501787 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e2c010fd-de1c-43bc-8aca-476947519f81 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:20.516384 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e2c010fd-de1c-43bc-8aca-476947519f81 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:20.518411 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e2c010fd-de1c-43bc-8aca-476947519f81 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:20.526579 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e2c010fd-de1c-43bc-8aca-476947519f81 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1724 microversion: 2.20 time: 0.197409 Jun 06 21:09:20.527425 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 277/550] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:09:20 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:09:21.546244 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-63ae5193-6fc3-47e1-bab6-69e53594cf97 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:21.547035 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-63ae5193-6fc3-47e1-bab6-69e53594cf97 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:21.557313 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-63ae5193-6fc3-47e1-bab6-69e53594cf97 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:21.557756 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-63ae5193-6fc3-47e1-bab6-69e53594cf97 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:21.558648 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-63ae5193-6fc3-47e1-bab6-69e53594cf97 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:21.559092 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-63ae5193-6fc3-47e1-bab6-69e53594cf97 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:21.706443 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-63ae5193-6fc3-47e1-bab6-69e53594cf97 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:21.715280 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-63ae5193-6fc3-47e1-bab6-69e53594cf97 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:21.716858 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-63ae5193-6fc3-47e1-bab6-69e53594cf97 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:21.718123 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-63ae5193-6fc3-47e1-bab6-69e53594cf97 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1724 microversion: 2.20 time: 0.176261 Jun 06 21:09:21.718735 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 274/551] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:09:21 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:09:22.737439 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-049e4cd6-6d38-4ec8-a7f3-fd3aaded8b6c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:22.738176 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-049e4cd6-6d38-4ec8-a7f3-fd3aaded8b6c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:22.745602 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-049e4cd6-6d38-4ec8-a7f3-fd3aaded8b6c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:22.746019 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-049e4cd6-6d38-4ec8-a7f3-fd3aaded8b6c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:22.746819 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-049e4cd6-6d38-4ec8-a7f3-fd3aaded8b6c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:22.747252 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-049e4cd6-6d38-4ec8-a7f3-fd3aaded8b6c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:22.897711 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-049e4cd6-6d38-4ec8-a7f3-fd3aaded8b6c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:22.906833 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-049e4cd6-6d38-4ec8-a7f3-fd3aaded8b6c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:22.908364 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-049e4cd6-6d38-4ec8-a7f3-fd3aaded8b6c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:22.909567 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-049e4cd6-6d38-4ec8-a7f3-fd3aaded8b6c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1724 microversion: 2.20 time: 0.176249 Jun 06 21:09:22.910170 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 278/552] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:09:22 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:09:23.928556 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-f584efe9-802e-4ca2-b91a-9a7a6e84399c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:23.929105 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-f584efe9-802e-4ca2-b91a-9a7a6e84399c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:23.935623 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f584efe9-802e-4ca2-b91a-9a7a6e84399c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:23.936101 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f584efe9-802e-4ca2-b91a-9a7a6e84399c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:23.936865 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f584efe9-802e-4ca2-b91a-9a7a6e84399c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:23.937305 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f584efe9-802e-4ca2-b91a-9a7a6e84399c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:24.074505 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-f584efe9-802e-4ca2-b91a-9a7a6e84399c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:24.083549 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-f584efe9-802e-4ca2-b91a-9a7a6e84399c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:24.085095 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-f584efe9-802e-4ca2-b91a-9a7a6e84399c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:24.086272 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-f584efe9-802e-4ca2-b91a-9a7a6e84399c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1724 microversion: 2.20 time: 0.162043 Jun 06 21:09:24.087173 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 275/553] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:09:23 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:09:24.711267 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8ba9777d-6697-430a-b828-dae0534e38ee tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1490152344", "imageRef": "e4266a01-7d22-4036-91e8-3ec50e3369c1", "flavorRef": "452", "networks": [{"uuid": "cf86e52e-aa4a-463e-8a33-f4fd34970315"}]}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:09:24.765052 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-8ba9777d-6697-430a-b828-dae0534e38ee tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] validate_networks() for [('cf86e52e-aa4a-463e-8a33-f4fd34970315', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 21:09:25.107817 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-60b62f7d-fb5d-40dc-aa1b-913d8bf3f634 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:25.109067 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-60b62f7d-fb5d-40dc-aa1b-913d8bf3f634 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:25.120926 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-60b62f7d-fb5d-40dc-aa1b-913d8bf3f634 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:25.121724 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-60b62f7d-fb5d-40dc-aa1b-913d8bf3f634 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:25.123249 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-60b62f7d-fb5d-40dc-aa1b-913d8bf3f634 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:25.124146 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-60b62f7d-fb5d-40dc-aa1b-913d8bf3f634 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:25.226195 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-60b62f7d-fb5d-40dc-aa1b-913d8bf3f634 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:25.238788 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-60b62f7d-fb5d-40dc-aa1b-913d8bf3f634 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:25.240351 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-60b62f7d-fb5d-40dc-aa1b-913d8bf3f634 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:25.241966 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-60b62f7d-fb5d-40dc-aa1b-913d8bf3f634 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 200 len: 1656 microversion: 2.20 time: 0.140131 Jun 06 21:09:25.242544 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 276/554] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:09:25 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 1656 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:09:25.257552 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-87a0ca43-a908-4e1c-9cff-196ec8676599 req-a6afca7d-fb6f-49e7-be45-d3d35235bea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1886e3bf-c735-4f91-8a2f-0bc6996982e0", "name": "network-vif-deleted", "tag": "2e4dc91b-9fa1-4ca1-9827-0ca3ef02a18e"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:09:25.266591 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-87a0ca43-a908-4e1c-9cff-196ec8676599 req-a6afca7d-fb6f-49e7-be45-d3d35235bea3 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:25.267388 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-87a0ca43-a908-4e1c-9cff-196ec8676599 req-a6afca7d-fb6f-49e7-be45-d3d35235bea3 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:25.285352 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-87a0ca43-a908-4e1c-9cff-196ec8676599 req-a6afca7d-fb6f-49e7-be45-d3d35235bea3 service nova] Creating event network-vif-deleted:2e4dc91b-9fa1-4ca1-9827-0ca3ef02a18e for instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 on hv-cinder-84488 Jun 06 21:09:25.296953 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-87a0ca43-a908-4e1c-9cff-196ec8676599 req-a6afca7d-fb6f-49e7-be45-d3d35235bea3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042977 Jun 06 21:09:25.298655 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 277/555] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:09:25.551565 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-8ba9777d-6697-430a-b828-dae0534e38ee tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 21:09:25.552389 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-8ba9777d-6697-430a-b828-dae0534e38ee tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 21:09:25.553257 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-8ba9777d-6697-430a-b828-dae0534e38ee tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 21:09:25.554003 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-8ba9777d-6697-430a-b828-dae0534e38ee tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 21:09:25.554725 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-8ba9777d-6697-430a-b828-dae0534e38ee tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 21:09:25.566875 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8ba9777d-6697-430a-b828-dae0534e38ee tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:25.567650 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8ba9777d-6697-430a-b828-dae0534e38ee tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:25.568603 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8ba9777d-6697-430a-b828-dae0534e38ee tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:25.569039 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8ba9777d-6697-430a-b828-dae0534e38ee tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:25.588238 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-8ba9777d-6697-430a-b828-dae0534e38ee tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Getting quotas for project a00a423b890b4dc0b4410220da7cdaa8. Resources: {'ram', 'cores', 'instances'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:09:25.592745 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-8ba9777d-6697-430a-b828-dae0534e38ee tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Getting quotas for user 3f74038b57aa477283f7c8fabebd19be and project a00a423b890b4dc0b4410220da7cdaa8. Resources: {'ram', 'cores', 'instances'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:09:25.605233 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8ba9777d-6697-430a-b828-dae0534e38ee tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 21:09:25.607753 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8ba9777d-6697-430a-b828-dae0534e38ee tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 6f153f74-57e8-4d72-9c9d-8b8c03bf7938] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4266a01-7d22-4036-91e8-3ec50e3369c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 21:09:25.656716 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8ba9777d-6697-430a-b828-dae0534e38ee tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.949516 Jun 06 21:09:25.657445 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 279/556] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 6 21:09:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 21:09:25.668372 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2120b315-e24c-42db-9e46-e897aa98e56f tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:25.669192 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-2120b315-e24c-42db-9e46-e897aa98e56f tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 6f153f74-57e8-4d72-9c9d-8b8c03bf7938] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:25.735590 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2120b315-e24c-42db-9e46-e897aa98e56f tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:25.744111 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-2120b315-e24c-42db-9e46-e897aa98e56f tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938" status: 200 len: 1219 microversion: 2.1 time: 0.079998 Jun 06 21:09:25.745214 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 278/557] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:09:25 2022] GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:09:26.269680 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6c66fff0-8e96-47fd-b70d-9a5d77fcf4cd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:26.270430 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6c66fff0-8e96-47fd-b70d-9a5d77fcf4cd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:26.279712 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6c66fff0-8e96-47fd-b70d-9a5d77fcf4cd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:26.280212 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6c66fff0-8e96-47fd-b70d-9a5d77fcf4cd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:26.280983 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6c66fff0-8e96-47fd-b70d-9a5d77fcf4cd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:26.281414 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6c66fff0-8e96-47fd-b70d-9a5d77fcf4cd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:26.296350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-6c66fff0-8e96-47fd-b70d-9a5d77fcf4cd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] HTTP exception thrown: Instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 could not be found. Jun 06 21:09:26.298221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6c66fff0-8e96-47fd-b70d-9a5d77fcf4cd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Request method failure captured: Jun 06 21:09:26.298221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 HTTP/1.1 Jun 06 21:09:26.298221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:09:26.298221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:09:26.298221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:09:26.298221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:09:26.298221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:09:26.298221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:09:26.298221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:09:26.298221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:09:26.298221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinmv_Hfhoy2QIopvOFM_96dkn6fhickDDxWtLiCyMewMq7-juzpNdxvYYZBIbKRfj3oHrWrKKD9DkfvUIX07YIBE2h_l4prVGC9U1v_r9lQ9TF648VZtk4TB5mA_nn5gz6Anm1H4Q0OPa9D61Bl54OhTn_NVncQCLkKTdKNCXSb6ENjs Jun 06 21:09:26.298221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:09:26.298221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:09:26.298221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:09:26.298221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:09:26.298221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 21:09:26.298221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:09:26.298221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:09:26.298221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 576ccf22c37f44fcbe449838cb5673f6 Jun 06 21:09:26.298221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-440411712 Jun 06 21:09:26.298221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:09:26.298221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:09:26.299830 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:09:26.299830 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeShelveTestJSON-440411712 Jun 06 21:09:26.299830 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 576ccf22c37f44fcbe449838cb5673f6 Jun 06 21:09:26.299830 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-440411712 Jun 06 21:09:26.299830 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeShelveTestJSON-440411712-project Jun 06 21:09:26.299830 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:09:26.299830 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:09:26.299830 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: 602aaa469bed4617b1a0385087066c93 Jun 06 21:09:26.299830 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeShelveTestJSON-440411712-project Jun 06 21:09:26.299830 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: > Jun 06 21:09:26.299830 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 could not be found. Jun 06 21:09:26.299830 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '1886e3bf-c735-4f91-8a2f-0bc6996982e0'} Jun 06 21:09:26.300937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:09:26.300937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:09:26.300937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:09:26.300937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:09:26.300937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:09:26.300937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:09:26.300937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:09:26.300937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:09:26.300937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:09:26.300937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:09:26.300937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 could not be found. Jun 06 21:09:26.300937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:09:26.300937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:09:26.300937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:09:26.300937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:09:26.300937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:09:26.300937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:09:26.300937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:09:26.300937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:09:26.300937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:09:26.302588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:09:26.302588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:09:26.302588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:09:26.302588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:09:26.302588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:09:26.302588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:09:26.302588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:09:26.302588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 could not be found. Jun 06 21:09:26.302588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:09:26.302588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:09:26.302588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:09:26.302588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:09:26.302588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:09:26.302588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:09:26.302588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:09:26.302588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:09:26.302588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 could not be found. Jun 06 21:09:26.302588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:09:26.304715 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6c66fff0-8e96-47fd-b70d-9a5d77fcf4cd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Returning 404 to user: Instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:09:26.304715 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6c66fff0-8e96-47fd-b70d-9a5d77fcf4cd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 404 len: 111 microversion: 2.20 time: 0.034645 Jun 06 21:09:26.304715 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 280/558] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:09:26 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 21:09:26.309797 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e84cd650-159f-4447-90fc-28fce23246cc tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '.version_select at 0x7f2725fab8b0>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:26.341404 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-e84cd650-159f-4447-90fc-28fce23246cc tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1727888521" status: 204 len: 0 microversion: 2.20 time: 0.035000 Jun 06 21:09:26.342266 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 279/559] 10.222.0.33 () {60 vars in 1261 bytes} [Mon Jun 6 21:09:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1727888521 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 06 21:09:26.763470 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f94bc26d-11cd-4b9d-8587-13a648b20347 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:26.763983 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f94bc26d-11cd-4b9d-8587-13a648b20347 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 6f153f74-57e8-4d72-9c9d-8b8c03bf7938] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:26.770960 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f94bc26d-11cd-4b9d-8587-13a648b20347 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:26.771667 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f94bc26d-11cd-4b9d-8587-13a648b20347 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:26.772629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f94bc26d-11cd-4b9d-8587-13a648b20347 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:26.773226 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f94bc26d-11cd-4b9d-8587-13a648b20347 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:26.883674 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f94bc26d-11cd-4b9d-8587-13a648b20347 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:26.892083 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f94bc26d-11cd-4b9d-8587-13a648b20347 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938" status: 200 len: 1279 microversion: 2.1 time: 0.132430 Jun 06 21:09:26.892693 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 281/560] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:09:26 2022] GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938 => generated 1279 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:09:27.257714 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-9532f160-a8a5-41de-ac25-fe69c0efb6a2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Action: 'create', calling method: .version_select at 0x7f2725fab1f0>, body: {"keypair": {"name": "tempest-keypair-84051738", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaSB8OBSTdqtJcch8CUlIRJu+Ym5cricxbaeFOy84vLXVJ74KGGIYzZJeFsZcuOeDDLCjJOy+bxHGom3BTs24ld4+RbtHy4LITUibHKt+wVVQ0ENrGdyhRBykpIaMle1w=="}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:09:27.276767 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-9532f160-a8a5-41de-ac25-fe69c0efb6a2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Getting quotas for project 576ccf22c37f44fcbe449838cb5673f6. Resources: {'key_pairs'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:09:27.280481 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-9532f160-a8a5-41de-ac25-fe69c0efb6a2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Getting quotas for user 602aaa469bed4617b1a0385087066c93 and project 576ccf22c37f44fcbe449838cb5673f6. Resources: {'key_pairs'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:09:27.305243 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-9532f160-a8a5-41de-ac25-fe69c0efb6a2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.051692 Jun 06 21:09:27.305842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 280/561] 10.222.0.33 () {62 vars in 1199 bytes} [Mon Jun 6 21:09:27 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 06 21:09:27.909035 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d8e4a9b2-2545-4b9e-b3b8-2ba96e484112 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:27.910862 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d8e4a9b2-2545-4b9e-b3b8-2ba96e484112 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 6f153f74-57e8-4d72-9c9d-8b8c03bf7938] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:27.918575 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8e4a9b2-2545-4b9e-b3b8-2ba96e484112 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:27.919028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8e4a9b2-2545-4b9e-b3b8-2ba96e484112 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:27.920100 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8e4a9b2-2545-4b9e-b3b8-2ba96e484112 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:27.921213 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8e4a9b2-2545-4b9e-b3b8-2ba96e484112 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:28.206841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d8e4a9b2-2545-4b9e-b3b8-2ba96e484112 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:28.216407 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d8e4a9b2-2545-4b9e-b3b8-2ba96e484112 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938" status: 200 len: 1319 microversion: 2.1 time: 0.311160 Jun 06 21:09:28.217003 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 282/562] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:09:27 2022] GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938 => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:09:28.599970 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-53df33d7-3466-435a-9be9-aed7fdeee5b5 req-76d30e98-b5a9-44e5-9b85-61a5fbc45470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f153f74-57e8-4d72-9c9d-8b8c03bf7938", "tag": "0fd3a7f9-5027-46e9-ab80-828c29c6a3b5"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:09:28.630496 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-53df33d7-3466-435a-9be9-aed7fdeee5b5 req-76d30e98-b5a9-44e5-9b85-61a5fbc45470 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:28.631289 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-53df33d7-3466-435a-9be9-aed7fdeee5b5 req-76d30e98-b5a9-44e5-9b85-61a5fbc45470 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:28.644337 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-53df33d7-3466-435a-9be9-aed7fdeee5b5 req-76d30e98-b5a9-44e5-9b85-61a5fbc45470 service nova] Creating event network-changed:0fd3a7f9-5027-46e9-ab80-828c29c6a3b5 for instance 6f153f74-57e8-4d72-9c9d-8b8c03bf7938 on hv-cinder-84488 Jun 06 21:09:28.649658 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-53df33d7-3466-435a-9be9-aed7fdeee5b5 req-76d30e98-b5a9-44e5-9b85-61a5fbc45470 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057961 Jun 06 21:09:28.650411 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 281/563] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:09:29.179529 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a3ea6b73-27ed-4e31-a7ff-54fa44f0f856 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1165606778", "imageRef": "e4266a01-7d22-4036-91e8-3ec50e3369c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a66e5149-d2b2-496e-8506-4294d2b66e2c"}], "security_groups": [{"name": "tempest-securitygroup--865664244"}], "key_name": "tempest-keypair-84051738", "user_data": "}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:09:29.235007 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2e32e541-02ba-437a-9d8a-c5e0d0387a25 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:29.235756 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-2e32e541-02ba-437a-9d8a-c5e0d0387a25 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 6f153f74-57e8-4d72-9c9d-8b8c03bf7938] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:29.242811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2e32e541-02ba-437a-9d8a-c5e0d0387a25 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:29.243255 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2e32e541-02ba-437a-9d8a-c5e0d0387a25 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:29.244065 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2e32e541-02ba-437a-9d8a-c5e0d0387a25 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:29.244512 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2e32e541-02ba-437a-9d8a-c5e0d0387a25 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:29.292335 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-a3ea6b73-27ed-4e31-a7ff-54fa44f0f856 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] validate_networks() for [('a66e5149-d2b2-496e-8506-4294d2b66e2c', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 21:09:29.508454 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2e32e541-02ba-437a-9d8a-c5e0d0387a25 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:29.516232 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-2e32e541-02ba-437a-9d8a-c5e0d0387a25 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938" status: 200 len: 1319 microversion: 2.1 time: 0.285924 Jun 06 21:09:29.516818 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 282/564] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:09:29 2022] GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938 => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:09:29.697486 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-a3ea6b73-27ed-4e31-a7ff-54fa44f0f856 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 21:09:29.697909 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-a3ea6b73-27ed-4e31-a7ff-54fa44f0f856 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 21:09:29.698385 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-a3ea6b73-27ed-4e31-a7ff-54fa44f0f856 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 21:09:29.698790 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-a3ea6b73-27ed-4e31-a7ff-54fa44f0f856 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 21:09:29.699233 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-a3ea6b73-27ed-4e31-a7ff-54fa44f0f856 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 21:09:29.708682 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a3ea6b73-27ed-4e31-a7ff-54fa44f0f856 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:29.709125 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a3ea6b73-27ed-4e31-a7ff-54fa44f0f856 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:29.709921 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a3ea6b73-27ed-4e31-a7ff-54fa44f0f856 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:29.710387 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a3ea6b73-27ed-4e31-a7ff-54fa44f0f856 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:29.728562 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-a3ea6b73-27ed-4e31-a7ff-54fa44f0f856 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Getting quotas for project 576ccf22c37f44fcbe449838cb5673f6. Resources: {'ram', 'cores', 'instances'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:09:29.732888 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-a3ea6b73-27ed-4e31-a7ff-54fa44f0f856 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Getting quotas for user 602aaa469bed4617b1a0385087066c93 and project 576ccf22c37f44fcbe449838cb5673f6. Resources: {'ram', 'cores', 'instances'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:09:29.745476 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a3ea6b73-27ed-4e31-a7ff-54fa44f0f856 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 21:09:29.747735 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a3ea6b73-27ed-4e31-a7ff-54fa44f0f856 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4266a01-7d22-4036-91e8-3ec50e3369c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 21:09:29.806444 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a3ea6b73-27ed-4e31-a7ff-54fa44f0f856 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.631361 Jun 06 21:09:29.807099 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 283/565] 10.222.0.33 () {62 vars in 1187 bytes} [Mon Jun 6 21:09:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 633 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 06 21:09:29.817758 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2c05bbd0-c4fc-44ec-9add-61281967e505 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:29.818506 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-2c05bbd0-c4fc-44ec-9add-61281967e505 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:29.880129 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2c05bbd0-c4fc-44ec-9add-61281967e505 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:29.888426 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2c05bbd0-c4fc-44ec-9add-61281967e505 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:29.889930 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2c05bbd0-c4fc-44ec-9add-61281967e505 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:29.891496 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-2c05bbd0-c4fc-44ec-9add-61281967e505 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1280 microversion: 2.20 time: 0.077453 Jun 06 21:09:29.891974 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 283/566] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:09:29 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1280 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:09:30.534454 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-152c358a-3105-420c-8265-fb55231eec64 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:30.535238 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-152c358a-3105-420c-8265-fb55231eec64 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 6f153f74-57e8-4d72-9c9d-8b8c03bf7938] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:30.543842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-152c358a-3105-420c-8265-fb55231eec64 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:30.544329 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-152c358a-3105-420c-8265-fb55231eec64 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:30.545305 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-152c358a-3105-420c-8265-fb55231eec64 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:30.545893 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-152c358a-3105-420c-8265-fb55231eec64 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:30.710006 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-152c358a-3105-420c-8265-fb55231eec64 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:30.718197 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-152c358a-3105-420c-8265-fb55231eec64 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938" status: 200 len: 1319 microversion: 2.1 time: 0.188524 Jun 06 21:09:30.718791 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 284/567] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:09:30 2022] GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:09:30.914673 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-3b1e505c-2507-40d5-9a75-78f739741fa4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:30.919136 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-3b1e505c-2507-40d5-9a75-78f739741fa4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:30.933006 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3b1e505c-2507-40d5-9a75-78f739741fa4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:30.934201 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3b1e505c-2507-40d5-9a75-78f739741fa4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:30.937321 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3b1e505c-2507-40d5-9a75-78f739741fa4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:30.938196 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3b1e505c-2507-40d5-9a75-78f739741fa4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:31.099873 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-3b1e505c-2507-40d5-9a75-78f739741fa4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:31.109727 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-3b1e505c-2507-40d5-9a75-78f739741fa4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:31.111495 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-3b1e505c-2507-40d5-9a75-78f739741fa4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:31.113554 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-3b1e505c-2507-40d5-9a75-78f739741fa4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1332 microversion: 2.20 time: 0.206920 Jun 06 21:09:31.114402 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 284/568] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:09:30 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1332 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:09:31.736161 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c5c8bf9d-48df-40ff-ad0d-04ab6ba0cf8d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:31.737009 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c5c8bf9d-48df-40ff-ad0d-04ab6ba0cf8d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 6f153f74-57e8-4d72-9c9d-8b8c03bf7938] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:31.744204 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c5c8bf9d-48df-40ff-ad0d-04ab6ba0cf8d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:31.744623 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c5c8bf9d-48df-40ff-ad0d-04ab6ba0cf8d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:31.745399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c5c8bf9d-48df-40ff-ad0d-04ab6ba0cf8d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:31.745825 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c5c8bf9d-48df-40ff-ad0d-04ab6ba0cf8d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:31.966282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c5c8bf9d-48df-40ff-ad0d-04ab6ba0cf8d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:31.974718 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c5c8bf9d-48df-40ff-ad0d-04ab6ba0cf8d tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938" status: 200 len: 1319 microversion: 2.1 time: 0.242557 Jun 06 21:09:31.975383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 285/569] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:09:31 2022] GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:09:32.134948 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-a47c2d1f-ed8c-4ab7-a935-e2fa6f1ddb48 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:32.136772 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-a47c2d1f-ed8c-4ab7-a935-e2fa6f1ddb48 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:32.148704 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a47c2d1f-ed8c-4ab7-a935-e2fa6f1ddb48 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:32.149491 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a47c2d1f-ed8c-4ab7-a935-e2fa6f1ddb48 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:32.150876 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a47c2d1f-ed8c-4ab7-a935-e2fa6f1ddb48 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:32.151665 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a47c2d1f-ed8c-4ab7-a935-e2fa6f1ddb48 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:32.463210 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-a47c2d1f-ed8c-4ab7-a935-e2fa6f1ddb48 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:32.473466 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-a47c2d1f-ed8c-4ab7-a935-e2fa6f1ddb48 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:32.474987 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-a47c2d1f-ed8c-4ab7-a935-e2fa6f1ddb48 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:32.476160 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-a47c2d1f-ed8c-4ab7-a935-e2fa6f1ddb48 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1405 microversion: 2.20 time: 0.347293 Jun 06 21:09:32.476735 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 285/570] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:09:32 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1405 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:09:32.915955 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-d7767f8a-676f-42a9-9468-7f75905a9187 req-afe361eb-0ab0-42cb-b01c-4377b34bf0b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5670bfe4-7e75-44cc-93c9-59dbaad0a0b2", "tag": "04c1ea5e-e07f-49da-aad5-775bd6da5cac"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:09:32.930249 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-d7767f8a-676f-42a9-9468-7f75905a9187 req-afe361eb-0ab0-42cb-b01c-4377b34bf0b0 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:32.932027 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-d7767f8a-676f-42a9-9468-7f75905a9187 req-afe361eb-0ab0-42cb-b01c-4377b34bf0b0 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:32.948548 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-d7767f8a-676f-42a9-9468-7f75905a9187 req-afe361eb-0ab0-42cb-b01c-4377b34bf0b0 service nova] Creating event network-changed:04c1ea5e-e07f-49da-aad5-775bd6da5cac for instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 on hv-cinder-84488 Jun 06 21:09:32.955037 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-d7767f8a-676f-42a9-9468-7f75905a9187 req-afe361eb-0ab0-42cb-b01c-4377b34bf0b0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047715 Jun 06 21:09:32.955710 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 286/571] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:09:32.994688 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-7a16b10b-d3e3-49e7-a49a-e8b58e2cc0f9 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:32.996120 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-7a16b10b-d3e3-49e7-a49a-e8b58e2cc0f9 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 6f153f74-57e8-4d72-9c9d-8b8c03bf7938] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:33.008202 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7a16b10b-d3e3-49e7-a49a-e8b58e2cc0f9 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:33.008833 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7a16b10b-d3e3-49e7-a49a-e8b58e2cc0f9 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:33.009639 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7a16b10b-d3e3-49e7-a49a-e8b58e2cc0f9 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:33.010066 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7a16b10b-d3e3-49e7-a49a-e8b58e2cc0f9 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:33.306081 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-7a16b10b-d3e3-49e7-a49a-e8b58e2cc0f9 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:33.322968 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-7a16b10b-d3e3-49e7-a49a-e8b58e2cc0f9 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938" status: 200 len: 1319 microversion: 2.1 time: 0.334031 Jun 06 21:09:33.324063 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 286/572] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:09:32 2022] GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938 => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:09:33.496625 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-54d06c8f-49cb-4834-8375-3a9375c5c075 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:33.497912 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-54d06c8f-49cb-4834-8375-3a9375c5c075 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:33.508133 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-54d06c8f-49cb-4834-8375-3a9375c5c075 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:33.508817 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-54d06c8f-49cb-4834-8375-3a9375c5c075 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:33.509980 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-54d06c8f-49cb-4834-8375-3a9375c5c075 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:33.510629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-54d06c8f-49cb-4834-8375-3a9375c5c075 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:33.677497 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-54d06c8f-49cb-4834-8375-3a9375c5c075 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:33.689514 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-54d06c8f-49cb-4834-8375-3a9375c5c075 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:33.691486 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-54d06c8f-49cb-4834-8375-3a9375c5c075 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:33.692752 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-54d06c8f-49cb-4834-8375-3a9375c5c075 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1405 microversion: 2.20 time: 0.201376 Jun 06 21:09:33.693327 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 287/573] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:09:33 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1405 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:09:34.341462 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0887c57a-5180-48f0-a075-067fb3a11660 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:34.342090 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-0887c57a-5180-48f0-a075-067fb3a11660 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 6f153f74-57e8-4d72-9c9d-8b8c03bf7938] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:34.349882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0887c57a-5180-48f0-a075-067fb3a11660 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:34.350325 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0887c57a-5180-48f0-a075-067fb3a11660 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:34.351097 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0887c57a-5180-48f0-a075-067fb3a11660 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:34.351538 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0887c57a-5180-48f0-a075-067fb3a11660 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:34.356154 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:09:34.500961 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-0887c57a-5180-48f0-a075-067fb3a11660 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:34.510071 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-0887c57a-5180-48f0-a075-067fb3a11660 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938" status: 200 len: 1319 microversion: 2.1 time: 0.172600 Jun 06 21:09:34.510745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 287/574] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:09:34 2022] GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:09:34.713227 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-72124cd1-7277-41b4-b81c-62c8cf966a91 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:34.713871 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-72124cd1-7277-41b4-b81c-62c8cf966a91 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:34.721949 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72124cd1-7277-41b4-b81c-62c8cf966a91 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:34.723151 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72124cd1-7277-41b4-b81c-62c8cf966a91 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:34.724052 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72124cd1-7277-41b4-b81c-62c8cf966a91 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:34.724484 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-72124cd1-7277-41b4-b81c-62c8cf966a91 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:34.844336 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-1b761c9f-0fde-4638-8c09-072afe134390 req-fbe66768-0e88-4bcb-af57-e45a19cbef3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f153f74-57e8-4d72-9c9d-8b8c03bf7938", "name": "network-vif-plugged", "status": "completed", "tag": "0fd3a7f9-5027-46e9-ab80-828c29c6a3b5"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:09:34.871063 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-1b761c9f-0fde-4638-8c09-072afe134390 req-fbe66768-0e88-4bcb-af57-e45a19cbef3c service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:34.871909 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-1b761c9f-0fde-4638-8c09-072afe134390 req-fbe66768-0e88-4bcb-af57-e45a19cbef3c service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:34.890634 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-72124cd1-7277-41b4-b81c-62c8cf966a91 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:34.891518 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-1b761c9f-0fde-4638-8c09-072afe134390 req-fbe66768-0e88-4bcb-af57-e45a19cbef3c service nova] Creating event network-vif-plugged:0fd3a7f9-5027-46e9-ab80-828c29c6a3b5 for instance 6f153f74-57e8-4d72-9c9d-8b8c03bf7938 on hv-cinder-84488 Jun 06 21:09:34.899614 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-1b761c9f-0fde-4638-8c09-072afe134390 req-fbe66768-0e88-4bcb-af57-e45a19cbef3c service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070441 Jun 06 21:09:34.901334 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-72124cd1-7277-41b4-b81c-62c8cf966a91 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:34.901458 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 288/575] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:09:34.902929 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-72124cd1-7277-41b4-b81c-62c8cf966a91 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:34.904201 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-72124cd1-7277-41b4-b81c-62c8cf966a91 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1405 microversion: 2.20 time: 0.195242 Jun 06 21:09:34.914952 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 288/576] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:09:34 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:09:35.529066 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b53fac1b-0745-4cf8-8dfd-7c9b934de189 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:35.529650 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-b53fac1b-0745-4cf8-8dfd-7c9b934de189 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 6f153f74-57e8-4d72-9c9d-8b8c03bf7938] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:35.536746 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b53fac1b-0745-4cf8-8dfd-7c9b934de189 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:35.537193 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b53fac1b-0745-4cf8-8dfd-7c9b934de189 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:35.537944 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b53fac1b-0745-4cf8-8dfd-7c9b934de189 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:35.538362 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b53fac1b-0745-4cf8-8dfd-7c9b934de189 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:35.695261 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-b53fac1b-0745-4cf8-8dfd-7c9b934de189 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:35.704172 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-b53fac1b-0745-4cf8-8dfd-7c9b934de189 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938" status: 200 len: 1319 microversion: 2.1 time: 0.179320 Jun 06 21:09:35.704779 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 289/577] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:09:35 2022] GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:09:35.922664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-78189b59-fed4-404e-85bd-a36557feec60 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:35.923304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-78189b59-fed4-404e-85bd-a36557feec60 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:35.931085 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-78189b59-fed4-404e-85bd-a36557feec60 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:35.931401 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-78189b59-fed4-404e-85bd-a36557feec60 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:35.932281 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-78189b59-fed4-404e-85bd-a36557feec60 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:35.932854 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-78189b59-fed4-404e-85bd-a36557feec60 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:35.952973 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:09:36.072617 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-78189b59-fed4-404e-85bd-a36557feec60 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:36.082320 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-78189b59-fed4-404e-85bd-a36557feec60 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:36.083955 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-78189b59-fed4-404e-85bd-a36557feec60 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:36.085106 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-78189b59-fed4-404e-85bd-a36557feec60 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1405 microversion: 2.20 time: 0.166470 Jun 06 21:09:36.085681 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 289/578] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:09:35 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:09:36.722016 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-f700c228-70cf-4f33-a798-5daaf85a0a91 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:36.722656 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-f700c228-70cf-4f33-a798-5daaf85a0a91 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 6f153f74-57e8-4d72-9c9d-8b8c03bf7938] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:36.729991 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f700c228-70cf-4f33-a798-5daaf85a0a91 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:36.730449 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f700c228-70cf-4f33-a798-5daaf85a0a91 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:36.731224 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f700c228-70cf-4f33-a798-5daaf85a0a91 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:36.731650 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f700c228-70cf-4f33-a798-5daaf85a0a91 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:36.877374 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-f700c228-70cf-4f33-a798-5daaf85a0a91 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:36.891175 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-f700c228-70cf-4f33-a798-5daaf85a0a91 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938" status: 200 len: 1319 microversion: 2.1 time: 0.173131 Jun 06 21:09:36.891890 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 290/579] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:09:36 2022] GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:09:37.105243 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-07320453-d43a-4ce3-9f6e-7a34cefbeeaf tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:37.106149 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-07320453-d43a-4ce3-9f6e-7a34cefbeeaf tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:37.112815 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07320453-d43a-4ce3-9f6e-7a34cefbeeaf tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:37.113256 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07320453-d43a-4ce3-9f6e-7a34cefbeeaf tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:37.114046 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07320453-d43a-4ce3-9f6e-7a34cefbeeaf tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:37.114562 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-07320453-d43a-4ce3-9f6e-7a34cefbeeaf tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:37.267173 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-07320453-d43a-4ce3-9f6e-7a34cefbeeaf tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:37.275652 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-07320453-d43a-4ce3-9f6e-7a34cefbeeaf tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:37.277198 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-07320453-d43a-4ce3-9f6e-7a34cefbeeaf tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:37.278565 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-07320453-d43a-4ce3-9f6e-7a34cefbeeaf tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1405 microversion: 2.20 time: 0.177191 Jun 06 21:09:37.279150 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 290/580] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:09:37 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:09:37.909053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-4d2ab2c7-3057-4da6-a3b0-370bedae7f85 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:37.910415 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-4d2ab2c7-3057-4da6-a3b0-370bedae7f85 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 6f153f74-57e8-4d72-9c9d-8b8c03bf7938] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:37.917729 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4d2ab2c7-3057-4da6-a3b0-370bedae7f85 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:37.918176 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4d2ab2c7-3057-4da6-a3b0-370bedae7f85 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:37.918966 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4d2ab2c7-3057-4da6-a3b0-370bedae7f85 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:37.919399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4d2ab2c7-3057-4da6-a3b0-370bedae7f85 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:38.070874 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-4d2ab2c7-3057-4da6-a3b0-370bedae7f85 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:38.079255 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-4d2ab2c7-3057-4da6-a3b0-370bedae7f85 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938" status: 200 len: 1507 microversion: 2.1 time: 0.174083 Jun 06 21:09:38.079873 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 291/581] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:09:37 2022] GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938 => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:09:38.096157 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9a83c07a-dbbc-4899-811c-d18c5891bb34 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b6c9156-0ab8-46ee-8b5a-98cd6cc9c9c9", "device": "/dev/sdb"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:09:38.097580 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9a83c07a-dbbc-4899-811c-d18c5891bb34 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 6f153f74-57e8-4d72-9c9d-8b8c03bf7938] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:38.104686 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9a83c07a-dbbc-4899-811c-d18c5891bb34 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:38.105164 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9a83c07a-dbbc-4899-811c-d18c5891bb34 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:38.105942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9a83c07a-dbbc-4899-811c-d18c5891bb34 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:38.107019 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9a83c07a-dbbc-4899-811c-d18c5891bb34 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:38.302723 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-db83c1c1-643d-49fa-9aec-92ce6d68b342 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:38.303431 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-db83c1c1-643d-49fa-9aec-92ce6d68b342 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:38.311536 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-db83c1c1-643d-49fa-9aec-92ce6d68b342 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:38.312106 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-db83c1c1-643d-49fa-9aec-92ce6d68b342 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:38.313317 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-db83c1c1-643d-49fa-9aec-92ce6d68b342 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:38.314089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-db83c1c1-643d-49fa-9aec-92ce6d68b342 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:38.411422 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9a83c07a-dbbc-4899-811c-d18c5891bb34 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "POST /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319063 Jun 06 21:09:38.412119 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 291/582] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 6 21:09:38 2022] POST /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938/os-volume_attachments => generated 194 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:09:38.513321 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-db83c1c1-643d-49fa-9aec-92ce6d68b342 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:38.525247 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-db83c1c1-643d-49fa-9aec-92ce6d68b342 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:38.526752 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-db83c1c1-643d-49fa-9aec-92ce6d68b342 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:38.527896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-db83c1c1-643d-49fa-9aec-92ce6d68b342 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1405 microversion: 2.20 time: 0.229335 Jun 06 21:09:38.528518 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 292/583] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:09:38 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1405 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:09:38.856593 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-12ac99df-a696-4a28-aae9-666dee7a3250 req-3bbf75e6-65b3-471f-8d91-62e292b6f8ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5670bfe4-7e75-44cc-93c9-59dbaad0a0b2", "name": "network-vif-plugged", "status": "completed", "tag": "04c1ea5e-e07f-49da-aad5-775bd6da5cac"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:09:38.866553 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-12ac99df-a696-4a28-aae9-666dee7a3250 req-3bbf75e6-65b3-471f-8d91-62e292b6f8ca service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:38.867001 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-12ac99df-a696-4a28-aae9-666dee7a3250 req-3bbf75e6-65b3-471f-8d91-62e292b6f8ca service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:38.880045 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-12ac99df-a696-4a28-aae9-666dee7a3250 req-3bbf75e6-65b3-471f-8d91-62e292b6f8ca service nova] Creating event network-vif-plugged:04c1ea5e-e07f-49da-aad5-775bd6da5cac for instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 on hv-cinder-84488 Jun 06 21:09:38.885192 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-12ac99df-a696-4a28-aae9-666dee7a3250 req-3bbf75e6-65b3-471f-8d91-62e292b6f8ca service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033172 Jun 06 21:09:38.885721 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 292/584] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:09:39.205616 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 21:09:39.206304 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Mon Jun 6 21:09:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 21:09:39.547160 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-8da9a509-b614-4b16-be3d-cb46d4b374c5 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:39.547813 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-8da9a509-b614-4b16-be3d-cb46d4b374c5 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:39.555492 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8da9a509-b614-4b16-be3d-cb46d4b374c5 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:39.556805 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8da9a509-b614-4b16-be3d-cb46d4b374c5 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:39.557733 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8da9a509-b614-4b16-be3d-cb46d4b374c5 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:39.558173 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8da9a509-b614-4b16-be3d-cb46d4b374c5 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:39.705459 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-8da9a509-b614-4b16-be3d-cb46d4b374c5 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:39.714473 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-8da9a509-b614-4b16-be3d-cb46d4b374c5 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:39.716028 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-8da9a509-b614-4b16-be3d-cb46d4b374c5 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:39.717173 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-8da9a509-b614-4b16-be3d-cb46d4b374c5 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1405 microversion: 2.20 time: 0.174157 Jun 06 21:09:39.717737 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 293/585] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:09:39 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:09:40.732976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=4 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:09:40.734081 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=12 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:09:40.739647 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-69674c10-2939-4e0c-89c5-0b0ff7ccbd32 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:40.740541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-69674c10-2939-4e0c-89c5-0b0ff7ccbd32 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:40.742604 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=6 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:09:40.749072 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-69674c10-2939-4e0c-89c5-0b0ff7ccbd32 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:40.749510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-69674c10-2939-4e0c-89c5-0b0ff7ccbd32 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:40.750304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-69674c10-2939-4e0c-89c5-0b0ff7ccbd32 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:40.750750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-69674c10-2939-4e0c-89c5-0b0ff7ccbd32 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:40.897455 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-69674c10-2939-4e0c-89c5-0b0ff7ccbd32 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:40.906301 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-69674c10-2939-4e0c-89c5-0b0ff7ccbd32 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:40.907629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-69674c10-2939-4e0c-89c5-0b0ff7ccbd32 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:40.908750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-69674c10-2939-4e0c-89c5-0b0ff7ccbd32 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1405 microversion: 2.20 time: 0.177411 Jun 06 21:09:40.909813 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 293/586] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:09:40 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:09:41.931120 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b45441b9-3ea4-43f6-ae45-dc43c1f6b88e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:41.931971 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-b45441b9-3ea4-43f6-ae45-dc43c1f6b88e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:41.934957 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=8 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:09:41.936618 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:09:41.945700 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b45441b9-3ea4-43f6-ae45-dc43c1f6b88e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:41.946254 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b45441b9-3ea4-43f6-ae45-dc43c1f6b88e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:41.947009 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b45441b9-3ea4-43f6-ae45-dc43c1f6b88e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:41.947430 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b45441b9-3ea4-43f6-ae45-dc43c1f6b88e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:42.084601 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-b45441b9-3ea4-43f6-ae45-dc43c1f6b88e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:42.092631 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-b45441b9-3ea4-43f6-ae45-dc43c1f6b88e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:42.094109 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-b45441b9-3ea4-43f6-ae45-dc43c1f6b88e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:42.095270 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-b45441b9-3ea4-43f6-ae45-dc43c1f6b88e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1597 microversion: 2.20 time: 0.170671 Jun 06 21:09:42.095816 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 294/587] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:09:41 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1597 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:09:42.112993 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fe7b9b65-bd00-4f95-801b-dc713f81e972 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:42.113682 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fe7b9b65-bd00-4f95-801b-dc713f81e972 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:42.120634 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe7b9b65-bd00-4f95-801b-dc713f81e972 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:42.121082 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe7b9b65-bd00-4f95-801b-dc713f81e972 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:42.121849 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe7b9b65-bd00-4f95-801b-dc713f81e972 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:42.122279 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe7b9b65-bd00-4f95-801b-dc713f81e972 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:42.203753 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fe7b9b65-bd00-4f95-801b-dc713f81e972 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.094654 Jun 06 21:09:42.204384 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 294/588] 10.222.0.33 () {60 vars in 1315 bytes} [Mon Jun 6 21:09:42 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 21:09:42.439347 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2f411fe7-52f9-4bba-b59d-9afa97d6620a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9b5dcf79-34f5-4bf0-a6a2-7e482687fdcb"}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:09:42.440583 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-2f411fe7-52f9-4bba-b59d-9afa97d6620a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:42.447470 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2f411fe7-52f9-4bba-b59d-9afa97d6620a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:42.447914 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2f411fe7-52f9-4bba-b59d-9afa97d6620a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:42.448727 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2f411fe7-52f9-4bba-b59d-9afa97d6620a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:42.449172 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2f411fe7-52f9-4bba-b59d-9afa97d6620a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:42.743107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-2f411fe7-52f9-4bba-b59d-9afa97d6620a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "POST /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306956 Jun 06 21:09:42.744444 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 295/589] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 6 21:09:42 2022] POST /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:09:43.472510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-f5ea3b8d-fdc7-4930-be06-51a31230d9eb req-54bba6bc-d5f3-4577-a369-883d1ceb0ef2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5670bfe4-7e75-44cc-93c9-59dbaad0a0b2", "tag": "04c1ea5e-e07f-49da-aad5-775bd6da5cac"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:09:43.480854 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-f5ea3b8d-fdc7-4930-be06-51a31230d9eb req-54bba6bc-d5f3-4577-a369-883d1ceb0ef2 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:43.481293 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-f5ea3b8d-fdc7-4930-be06-51a31230d9eb req-54bba6bc-d5f3-4577-a369-883d1ceb0ef2 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:43.492638 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-f5ea3b8d-fdc7-4930-be06-51a31230d9eb req-54bba6bc-d5f3-4577-a369-883d1ceb0ef2 service nova] Creating event network-changed:04c1ea5e-e07f-49da-aad5-775bd6da5cac for instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 on hv-cinder-84488 Jun 06 21:09:43.497661 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-f5ea3b8d-fdc7-4930-be06-51a31230d9eb req-54bba6bc-d5f3-4577-a369-883d1ceb0ef2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029383 Jun 06 21:09:43.498279 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 295/590] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:09:46.995159 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2d5612e3-8d61-4952-b147-54fdb91a7bcb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:46.995800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-2d5612e3-8d61-4952-b147-54fdb91a7bcb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:47.002985 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2d5612e3-8d61-4952-b147-54fdb91a7bcb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:47.003745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2d5612e3-8d61-4952-b147-54fdb91a7bcb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:47.004568 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2d5612e3-8d61-4952-b147-54fdb91a7bcb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:47.004995 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2d5612e3-8d61-4952-b147-54fdb91a7bcb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:47.031334 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-2d5612e3-8d61-4952-b147-54fdb91a7bcb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d/ips" status: 200 len: 150 microversion: 2.1 time: 0.040371 Jun 06 21:09:47.031903 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 296/591] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jun 6 21:09:46 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:09:50.523389 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fef279ee-f291-4eaa-9962-b9d2359a6eee tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf081110-f26f-450b-bce3-1148cd8803ab"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:09:50.528267 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fef279ee-f291-4eaa-9962-b9d2359a6eee tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:50.540054 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fef279ee-f291-4eaa-9962-b9d2359a6eee tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:50.540701 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fef279ee-f291-4eaa-9962-b9d2359a6eee tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:50.542058 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fef279ee-f291-4eaa-9962-b9d2359a6eee tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:50.542465 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fef279ee-f291-4eaa-9962-b9d2359a6eee tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:53.880104 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fef279ee-f291-4eaa-9962-b9d2359a6eee tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "POST /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.370904 Jun 06 21:09:53.881037 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 296/592] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 6 21:09:50 2022] POST /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d/os-volume_attachments => generated 194 bytes in 3373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:09:54.822600 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-03a15e14-b714-4bd8-beb7-1c822d36e0e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:09:54.825346 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-03a15e14-b714-4bd8-beb7-1c822d36e0e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:54.838470 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-03a15e14-b714-4bd8-beb7-1c822d36e0e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:54.839247 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-03a15e14-b714-4bd8-beb7-1c822d36e0e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:54.840677 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-03a15e14-b714-4bd8-beb7-1c822d36e0e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:54.841406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-03a15e14-b714-4bd8-beb7-1c822d36e0e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:54.877018 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.objects.instance [None req-03a15e14-b714-4bd8-beb7-1c822d36e0e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lazy-loading 'flavor' on Instance uuid a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 {{(pid=117860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:09:55.077003 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-03a15e14-b714-4bd8-beb7-1c822d36e0e9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "POST /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1/action" status: 200 len: 32 microversion: 2.1 time: 0.259857 Jun 06 21:09:55.078028 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 297/593] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 6 21:09:54 2022] POST /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1/action => generated 32 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 21:09:55.089238 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bacfc354-153e-4338-a98f-4a0d8f9acd0c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:55.089945 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bacfc354-153e-4338-a98f-4a0d8f9acd0c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:55.097056 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bacfc354-153e-4338-a98f-4a0d8f9acd0c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:55.097568 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bacfc354-153e-4338-a98f-4a0d8f9acd0c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:55.098389 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bacfc354-153e-4338-a98f-4a0d8f9acd0c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:55.099050 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bacfc354-153e-4338-a98f-4a0d8f9acd0c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:55.257638 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bacfc354-153e-4338-a98f-4a0d8f9acd0c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:55.266164 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bacfc354-153e-4338-a98f-4a0d8f9acd0c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1735 microversion: 2.1 time: 0.181895 Jun 06 21:09:55.266786 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 297/594] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:09:55 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:09:56.286353 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b3abff24-2a43-4b21-af8b-11f4e96a0824 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:56.287068 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-b3abff24-2a43-4b21-af8b-11f4e96a0824 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:56.294088 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b3abff24-2a43-4b21-af8b-11f4e96a0824 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:56.294534 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b3abff24-2a43-4b21-af8b-11f4e96a0824 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:56.295345 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b3abff24-2a43-4b21-af8b-11f4e96a0824 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:56.295767 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b3abff24-2a43-4b21-af8b-11f4e96a0824 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:56.462652 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-b3abff24-2a43-4b21-af8b-11f4e96a0824 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:56.474849 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-b3abff24-2a43-4b21-af8b-11f4e96a0824 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1735 microversion: 2.1 time: 0.192998 Jun 06 21:09:56.475693 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 298/595] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:09:56 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:09:57.493942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1a2064c3-1c96-4590-98f2-0aa050dbd8f0 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:57.494541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1a2064c3-1c96-4590-98f2-0aa050dbd8f0 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:57.501284 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a2064c3-1c96-4590-98f2-0aa050dbd8f0 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:57.501725 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a2064c3-1c96-4590-98f2-0aa050dbd8f0 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:57.502496 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a2064c3-1c96-4590-98f2-0aa050dbd8f0 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:57.503013 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a2064c3-1c96-4590-98f2-0aa050dbd8f0 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:57.663035 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1a2064c3-1c96-4590-98f2-0aa050dbd8f0 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:57.672039 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1a2064c3-1c96-4590-98f2-0aa050dbd8f0 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1735 microversion: 2.1 time: 0.182043 Jun 06 21:09:57.672645 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 298/596] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:09:57 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:09:58.097724 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-4ab41583-faf2-474b-9a88-1fea06940366 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:58.098353 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-4ab41583-faf2-474b-9a88-1fea06940366 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 6f153f74-57e8-4d72-9c9d-8b8c03bf7938] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:58.105806 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4ab41583-faf2-474b-9a88-1fea06940366 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:58.106261 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4ab41583-faf2-474b-9a88-1fea06940366 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:58.107048 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4ab41583-faf2-474b-9a88-1fea06940366 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:58.107479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4ab41583-faf2-474b-9a88-1fea06940366 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:58.251811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.objects.instance [None req-4ab41583-faf2-474b-9a88-1fea06940366 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lazy-loading 'services' on Instance uuid 6f153f74-57e8-4d72-9c9d-8b8c03bf7938 {{(pid=117860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:09:58.381595 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-4ab41583-faf2-474b-9a88-1fea06940366 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938/os-volume_attachments/8b6c9156-0ab8-46ee-8b5a-98cd6cc9c9c9" status: 202 len: 0 microversion: 2.1 time: 0.290193 Jun 06 21:09:58.382212 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 299/597] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 6 21:09:58 2022] DELETE /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938/os-volume_attachments/8b6c9156-0ab8-46ee-8b5a-98cd6cc9c9c9 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:09:58.695010 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d9878e6c-7c27-496a-b53a-deae6db910d2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:58.695636 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d9878e6c-7c27-496a-b53a-deae6db910d2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:58.703027 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d9878e6c-7c27-496a-b53a-deae6db910d2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:58.703472 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d9878e6c-7c27-496a-b53a-deae6db910d2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:58.704324 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d9878e6c-7c27-496a-b53a-deae6db910d2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:58.704823 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d9878e6c-7c27-496a-b53a-deae6db910d2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:58.878466 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d9878e6c-7c27-496a-b53a-deae6db910d2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:09:58.886852 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d9878e6c-7c27-496a-b53a-deae6db910d2 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1735 microversion: 2.1 time: 0.195915 Jun 06 21:09:58.887423 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 299/598] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:09:58 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:09:59.905416 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-76145802-79b6-41ee-8ac3-c1bd7667438b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:09:59.906097 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-76145802-79b6-41ee-8ac3-c1bd7667438b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:09:59.913951 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-76145802-79b6-41ee-8ac3-c1bd7667438b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:59.914390 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-76145802-79b6-41ee-8ac3-c1bd7667438b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:09:59.915152 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-76145802-79b6-41ee-8ac3-c1bd7667438b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:09:59.915574 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-76145802-79b6-41ee-8ac3-c1bd7667438b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:00.061940 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-76145802-79b6-41ee-8ac3-c1bd7667438b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:00.065546 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:10:00.072429 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-76145802-79b6-41ee-8ac3-c1bd7667438b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1735 microversion: 2.1 time: 0.171274 Jun 06 21:10:00.073017 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 300/599] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:09:59 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:01.090172 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-58692f1f-ffe9-4fe1-984e-0c63bb7048bd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:01.090788 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-58692f1f-ffe9-4fe1-984e-0c63bb7048bd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:01.097826 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-58692f1f-ffe9-4fe1-984e-0c63bb7048bd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:01.098247 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-58692f1f-ffe9-4fe1-984e-0c63bb7048bd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:01.099046 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-58692f1f-ffe9-4fe1-984e-0c63bb7048bd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:01.099477 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-58692f1f-ffe9-4fe1-984e-0c63bb7048bd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:01.249859 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-58692f1f-ffe9-4fe1-984e-0c63bb7048bd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:01.259721 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-58692f1f-ffe9-4fe1-984e-0c63bb7048bd tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1735 microversion: 2.1 time: 0.173564 Jun 06 21:10:01.260420 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 300/600] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:01 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:01.502396 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e3e4fc94-2566-4fa9-bfcd-ee1bb38b8406 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf081110-f26f-450b-bce3-1148cd8803ab"}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:10:01.505021 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-e3e4fc94-2566-4fa9-bfcd-ee1bb38b8406 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:01.518817 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e3e4fc94-2566-4fa9-bfcd-ee1bb38b8406 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:01.519632 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e3e4fc94-2566-4fa9-bfcd-ee1bb38b8406 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:01.521112 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e3e4fc94-2566-4fa9-bfcd-ee1bb38b8406 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:01.521885 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e3e4fc94-2566-4fa9-bfcd-ee1bb38b8406 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:01.626784 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-e3e4fc94-2566-4fa9-bfcd-ee1bb38b8406 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] HTTP exception thrown: Invalid volume: volume cf081110-f26f-450b-bce3-1148cd8803ab is already attached to instances: 9fe2313a-d12a-432f-b5b2-4f410f89682d Jun 06 21:10:01.631571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e3e4fc94-2566-4fa9-bfcd-ee1bb38b8406 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Request method failure captured: Jun 06 21:10:01.631571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: POST /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d/os-volume_attachments HTTP/1.1 Jun 06 21:10:01.631571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:10:01.631571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:10:01.631571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:10:01.631571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 74 Jun 06 21:10:01.631571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:10:01.631571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:10:01.631571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:10:01.631571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:10:01.631571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinmvxW1bVEWZVhCRlgeG6PDmaOvHpznA6mf68h7fAFngISNh4GnD9XFqvo52ymtA4PTaTSN-lCxDTYk7dFVIPU5elkSuX6Hf8rm-_SR1iR7N3wUEkc6KR6wmwlcMFMA3l3v8mmff7I1soQTiyS_qgppqz32gWX7gOKmiYav_WF1YU4TA Jun 06 21:10:01.631571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:10:01.631571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:10:01.631571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:10:01.631571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:10:01.631571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:10:01.631571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:10:01.631571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:10:01.631571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:10:01.631571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:10:01.631571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:10:01.633137 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:10:01.633137 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:10:01.633137 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:10:01.633137 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:10:01.633137 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:10:01.633137 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:10:01.633137 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:10:01.633137 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: 8713cb23a93147f8b52f88e240c81d6f Jun 06 21:10:01.633137 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:10:01.633137 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Jun 06 21:10:01.633137 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {"volumeAttachment": {"volumeId": "cf081110-f26f-450b-bce3-1148cd8803ab"}} Jun 06 21:10:01.633137 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: > Jun 06 21:10:01.633996 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Invalid volume: volume cf081110-f26f-450b-bce3-1148cd8803ab is already attached to instances: 9fe2313a-d12a-432f-b5b2-4f410f89682d Jun 06 21:10:01.633996 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'server_id': '9fe2313a-d12a-432f-b5b2-4f410f89682d', 'body': {'volumeAttachment': {'volumeId': 'cf081110-f26f-450b-bce3-1148cd8803ab'}}} Jun 06 21:10:01.633996 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:10:01.633996 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:10:01.633996 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 06 21:10:01.633996 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 06 21:10:01.633996 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 21:10:01.633996 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 21:10:01.633996 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 06 21:10:01.633996 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 06 21:10:01.633996 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 06 21:10:01.633996 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 06 21:10:01.633996 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 06 21:10:01.633996 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 06 21:10:01.633996 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume cf081110-f26f-450b-bce3-1148cd8803ab is already attached to instances: 9fe2313a-d12a-432f-b5b2-4f410f89682d Jun 06 21:10:01.633996 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:10:01.633996 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:10:01.633996 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:10:01.633996 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:10:01.635543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:10:01.635543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:10:01.635543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:10:01.635543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:10:01.635543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:10:01.635543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:10:01.635543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 21:10:01.635543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 21:10:01.635543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 21:10:01.635543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 21:10:01.635543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 21:10:01.635543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 21:10:01.635543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 06 21:10:01.635543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 06 21:10:01.635543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume cf081110-f26f-450b-bce3-1148cd8803ab is already attached to instances: 9fe2313a-d12a-432f-b5b2-4f410f89682d Jun 06 21:10:01.635543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:10:01.635543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:10:01.635543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:10:01.635543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:10:01.635543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:10:01.636853 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:10:01.636853 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:10:01.636853 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:10:01.636853 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume cf081110-f26f-450b-bce3-1148cd8803ab is already attached to instances: 9fe2313a-d12a-432f-b5b2-4f410f89682d Jun 06 21:10:01.636853 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:10:01.636853 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e3e4fc94-2566-4fa9-bfcd-ee1bb38b8406 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Returning 400 to user: Invalid volume: volume cf081110-f26f-450b-bce3-1148cd8803ab is already attached to instances: 9fe2313a-d12a-432f-b5b2-4f410f89682d {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:10:01.636853 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-e3e4fc94-2566-4fa9-bfcd-ee1bb38b8406 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "POST /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.140385 Jun 06 21:10:01.636853 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 301/601] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 6 21:10:01 2022] POST /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d/os-volume_attachments => generated 174 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 06 21:10:01.660413 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6151d994-ae13-49f6-9918-07cf9c794e77 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:01.660927 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6151d994-ae13-49f6-9918-07cf9c794e77 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 6f153f74-57e8-4d72-9c9d-8b8c03bf7938] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:01.668169 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6151d994-ae13-49f6-9918-07cf9c794e77 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:01.668517 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6151d994-ae13-49f6-9918-07cf9c794e77 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:01.669402 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6151d994-ae13-49f6-9918-07cf9c794e77 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:01.670146 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6151d994-ae13-49f6-9918-07cf9c794e77 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:01.702064 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6151d994-ae13-49f6-9918-07cf9c794e77 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 6f153f74-57e8-4d72-9c9d-8b8c03bf7938] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 21:10:01.721643 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-33926f78-71bd-479c-a7a4-5001c85994bc tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:01.722395 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-33926f78-71bd-479c-a7a4-5001c85994bc tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:01.734589 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-33926f78-71bd-479c-a7a4-5001c85994bc tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:01.735422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-33926f78-71bd-479c-a7a4-5001c85994bc tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:01.737164 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-33926f78-71bd-479c-a7a4-5001c85994bc tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:01.737950 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-33926f78-71bd-479c-a7a4-5001c85994bc tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:01.802939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6151d994-ae13-49f6-9918-07cf9c794e77 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938" status: 204 len: 0 microversion: 2.1 time: 0.146349 Jun 06 21:10:01.804123 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 301/602] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:10:01 2022] DELETE /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 06 21:10:01.813695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6267943f-75da-49c4-85e7-34526264f6fb tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:01.814408 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6267943f-75da-49c4-85e7-34526264f6fb tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 6f153f74-57e8-4d72-9c9d-8b8c03bf7938] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:01.821180 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6267943f-75da-49c4-85e7-34526264f6fb tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:01.821635 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6267943f-75da-49c4-85e7-34526264f6fb tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:01.822423 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6267943f-75da-49c4-85e7-34526264f6fb tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:01.822861 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6267943f-75da-49c4-85e7-34526264f6fb tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:01.856952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.objects.instance [None req-33926f78-71bd-479c-a7a4-5001c85994bc tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lazy-loading 'services' on Instance uuid 9fe2313a-d12a-432f-b5b2-4f410f89682d {{(pid=117860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:10:01.950340 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-33926f78-71bd-479c-a7a4-5001c85994bc tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d/os-volume_attachments/cf081110-f26f-450b-bce3-1148cd8803ab" status: 202 len: 0 microversion: 2.1 time: 0.236207 Jun 06 21:10:01.950959 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 302/603] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 6 21:10:01 2022] DELETE /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d/os-volume_attachments/cf081110-f26f-450b-bce3-1148cd8803ab => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:10:01.961860 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-85385681-7f5d-4c43-906a-3435cfe8ce39 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:01.962979 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-85385681-7f5d-4c43-906a-3435cfe8ce39 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:01.970369 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-85385681-7f5d-4c43-906a-3435cfe8ce39 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:01.970814 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-85385681-7f5d-4c43-906a-3435cfe8ce39 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:01.972718 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-85385681-7f5d-4c43-906a-3435cfe8ce39 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:01.972718 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-85385681-7f5d-4c43-906a-3435cfe8ce39 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:01.988936 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6267943f-75da-49c4-85e7-34526264f6fb tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:02.002347 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6267943f-75da-49c4-85e7-34526264f6fb tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938" status: 200 len: 1513 microversion: 2.1 time: 0.192808 Jun 06 21:10:02.003509 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 302/604] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:01 2022] GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938 => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:10:02.005216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-85385681-7f5d-4c43-906a-3435cfe8ce39 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049122 Jun 06 21:10:02.005795 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 303/605] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 6 21:10:01 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:10:02.277774 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6bd6cb9d-1b9d-45bc-afd8-551b1af0ca47 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:02.278484 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6bd6cb9d-1b9d-45bc-afd8-551b1af0ca47 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:02.285858 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6bd6cb9d-1b9d-45bc-afd8-551b1af0ca47 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:02.286321 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6bd6cb9d-1b9d-45bc-afd8-551b1af0ca47 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:02.287109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6bd6cb9d-1b9d-45bc-afd8-551b1af0ca47 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:02.287547 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6bd6cb9d-1b9d-45bc-afd8-551b1af0ca47 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:02.307685 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:10:02.669322 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6bd6cb9d-1b9d-45bc-afd8-551b1af0ca47 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:02.678423 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6bd6cb9d-1b9d-45bc-afd8-551b1af0ca47 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1735 microversion: 2.1 time: 0.404614 Jun 06 21:10:02.679116 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 303/606] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:02 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1735 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:03.017430 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-cd7b21b0-33be-4b87-b999-31c81b93112a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:03.018558 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-cd7b21b0-33be-4b87-b999-31c81b93112a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:03.026328 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-cd7b21b0-33be-4b87-b999-31c81b93112a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:03.026787 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-cd7b21b0-33be-4b87-b999-31c81b93112a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:03.027570 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-cd7b21b0-33be-4b87-b999-31c81b93112a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:03.028018 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-cd7b21b0-33be-4b87-b999-31c81b93112a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:03.029477 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fc828886-96e3-4452-bf14-f030aa5d85c3 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:03.030285 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fc828886-96e3-4452-bf14-f030aa5d85c3 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 6f153f74-57e8-4d72-9c9d-8b8c03bf7938] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:03.038568 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc828886-96e3-4452-bf14-f030aa5d85c3 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:03.039224 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc828886-96e3-4452-bf14-f030aa5d85c3 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:03.040261 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc828886-96e3-4452-bf14-f030aa5d85c3 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:03.040865 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc828886-96e3-4452-bf14-f030aa5d85c3 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:03.063935 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-cd7b21b0-33be-4b87-b999-31c81b93112a tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050601 Jun 06 21:10:03.064591 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 304/607] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 6 21:10:03 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:10:03.230591 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fc828886-96e3-4452-bf14-f030aa5d85c3 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:03.240121 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fc828886-96e3-4452-bf14-f030aa5d85c3 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938" status: 200 len: 1513 microversion: 2.1 time: 0.215170 Jun 06 21:10:03.240872 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 304/608] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:03 2022] GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938 => generated 1513 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:03.697470 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-4c91818d-1ec7-4df3-b6b4-b5c966b7e99d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:03.698080 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-4c91818d-1ec7-4df3-b6b4-b5c966b7e99d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:03.705107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4c91818d-1ec7-4df3-b6b4-b5c966b7e99d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:03.705575 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4c91818d-1ec7-4df3-b6b4-b5c966b7e99d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:03.706437 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4c91818d-1ec7-4df3-b6b4-b5c966b7e99d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:03.707000 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4c91818d-1ec7-4df3-b6b4-b5c966b7e99d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:03.994294 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-4c91818d-1ec7-4df3-b6b4-b5c966b7e99d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:04.003360 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-4c91818d-1ec7-4df3-b6b4-b5c966b7e99d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1735 microversion: 2.1 time: 0.309969 Jun 06 21:10:04.003954 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 305/609] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:03 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1735 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:04.075162 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2c5e3b8b-b91c-43b7-935f-83c7c0a67695 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:04.076215 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2c5e3b8b-b91c-43b7-935f-83c7c0a67695 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:04.083902 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2c5e3b8b-b91c-43b7-935f-83c7c0a67695 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:04.084399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2c5e3b8b-b91c-43b7-935f-83c7c0a67695 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:04.085180 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2c5e3b8b-b91c-43b7-935f-83c7c0a67695 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:04.085615 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2c5e3b8b-b91c-43b7-935f-83c7c0a67695 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:04.123443 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2c5e3b8b-b91c-43b7-935f-83c7c0a67695 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052264 Jun 06 21:10:04.124071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 305/610] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 6 21:10:04 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:10:04.262361 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-3b37e3ab-7dbb-49bb-9c90-43b169e216c4 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:04.264219 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-3b37e3ab-7dbb-49bb-9c90-43b169e216c4 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 6f153f74-57e8-4d72-9c9d-8b8c03bf7938] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:04.275525 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3b37e3ab-7dbb-49bb-9c90-43b169e216c4 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:04.277471 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3b37e3ab-7dbb-49bb-9c90-43b169e216c4 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:04.278688 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3b37e3ab-7dbb-49bb-9c90-43b169e216c4 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:04.279447 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3b37e3ab-7dbb-49bb-9c90-43b169e216c4 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:04.395949 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-3b37e3ab-7dbb-49bb-9c90-43b169e216c4 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3f74038b57aa477283f7c8fabebd19be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a00a423b890b4dc0b4410220da7cdaa8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:04.405885 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-3b37e3ab-7dbb-49bb-9c90-43b169e216c4 tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938" status: 200 len: 1471 microversion: 2.1 time: 0.150336 Jun 06 21:10:04.406524 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 306/611] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:04 2022] GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938 => generated 1471 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:10:04.450777 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-3f286c38-d0be-4af2-9f13-79565d965800 req-710f4ac0-aa2e-4594-9673-558a01e314f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f153f74-57e8-4d72-9c9d-8b8c03bf7938", "name": "network-vif-deleted", "tag": "0fd3a7f9-5027-46e9-ab80-828c29c6a3b5"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:10:04.463510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-3f286c38-d0be-4af2-9f13-79565d965800 req-710f4ac0-aa2e-4594-9673-558a01e314f6 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:04.463964 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-3f286c38-d0be-4af2-9f13-79565d965800 req-710f4ac0-aa2e-4594-9673-558a01e314f6 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:04.476793 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-3f286c38-d0be-4af2-9f13-79565d965800 req-710f4ac0-aa2e-4594-9673-558a01e314f6 service nova] Creating event network-vif-deleted:0fd3a7f9-5027-46e9-ab80-828c29c6a3b5 for instance 6f153f74-57e8-4d72-9c9d-8b8c03bf7938 on hv-cinder-84488 Jun 06 21:10:04.481899 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-3f286c38-d0be-4af2-9f13-79565d965800 req-710f4ac0-aa2e-4594-9673-558a01e314f6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035011 Jun 06 21:10:04.482509 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 306/612] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:10:05.023142 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-7f215403-6b2c-44fe-adf9-b296c677ee4f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:05.024233 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-7f215403-6b2c-44fe-adf9-b296c677ee4f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:05.032853 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7f215403-6b2c-44fe-adf9-b296c677ee4f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:05.033486 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7f215403-6b2c-44fe-adf9-b296c677ee4f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:05.035707 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7f215403-6b2c-44fe-adf9-b296c677ee4f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:05.036408 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7f215403-6b2c-44fe-adf9-b296c677ee4f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:05.138576 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9cd9315b-e803-487f-9947-79074fc13577 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:05.140191 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9cd9315b-e803-487f-9947-79074fc13577 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:05.151775 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9cd9315b-e803-487f-9947-79074fc13577 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:05.152675 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9cd9315b-e803-487f-9947-79074fc13577 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:05.154084 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9cd9315b-e803-487f-9947-79074fc13577 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:05.155153 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9cd9315b-e803-487f-9947-79074fc13577 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:05.201398 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9cd9315b-e803-487f-9947-79074fc13577 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069544 Jun 06 21:10:05.202795 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 307/613] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 6 21:10:05 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 06 21:10:05.236751 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-7f215403-6b2c-44fe-adf9-b296c677ee4f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:05.245968 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-7f215403-6b2c-44fe-adf9-b296c677ee4f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1735 microversion: 2.1 time: 0.228041 Jun 06 21:10:05.246574 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 307/614] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:05 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1735 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:05.278953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0b805ea2-956e-4eae-8de4-5a7b5eb4dbd7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:05.279520 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0b805ea2-956e-4eae-8de4-5a7b5eb4dbd7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:05.286512 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b805ea2-956e-4eae-8de4-5a7b5eb4dbd7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:05.286956 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b805ea2-956e-4eae-8de4-5a7b5eb4dbd7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:05.287806 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b805ea2-956e-4eae-8de4-5a7b5eb4dbd7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:05.288262 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b805ea2-956e-4eae-8de4-5a7b5eb4dbd7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:05.315424 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0b805ea2-956e-4eae-8de4-5a7b5eb4dbd7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 21:10:05.402474 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0b805ea2-956e-4eae-8de4-5a7b5eb4dbd7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d" status: 204 len: 0 microversion: 2.1 time: 0.127060 Jun 06 21:10:05.403495 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 308/615] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:10:05 2022] DELETE /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 21:10:05.413748 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-76b29e1a-0708-44d1-bf93-ab94ad2b79d5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:05.414369 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-76b29e1a-0708-44d1-bf93-ab94ad2b79d5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:05.422083 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-76b29e1a-0708-44d1-bf93-ab94ad2b79d5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:05.422526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-76b29e1a-0708-44d1-bf93-ab94ad2b79d5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:05.423291 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-76b29e1a-0708-44d1-bf93-ab94ad2b79d5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:05.423722 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-76b29e1a-0708-44d1-bf93-ab94ad2b79d5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:05.425223 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-874356ff-11a6-43e1-83de-a962318fc24f tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:05.426109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-874356ff-11a6-43e1-83de-a962318fc24f tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] [instance: 6f153f74-57e8-4d72-9c9d-8b8c03bf7938] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:05.433006 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-874356ff-11a6-43e1-83de-a962318fc24f tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:05.433454 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-874356ff-11a6-43e1-83de-a962318fc24f tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:05.434238 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-874356ff-11a6-43e1-83de-a962318fc24f tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:05.434665 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-874356ff-11a6-43e1-83de-a962318fc24f tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:05.463009 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-874356ff-11a6-43e1-83de-a962318fc24f tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] HTTP exception thrown: Instance 6f153f74-57e8-4d72-9c9d-8b8c03bf7938 could not be found. Jun 06 21:10:05.464706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-874356ff-11a6-43e1-83de-a962318fc24f tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Request method failure captured: Jun 06 21:10:05.464706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938 HTTP/1.1 Jun 06 21:10:05.464706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:10:05.464706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:10:05.464706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:10:05.464706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:10:05.464706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:10:05.464706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:10:05.464706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:10:05.464706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:10:05.464706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinmyy1aWtcoJ2Buw9t8XeCV0TYpUa17fkw8mN2kuFY1H31PzJElEniiTaOO5kGFcmNmJe2p_YGZRGNq0lpDzTv8eb9lSnELYAOVpbLSfde_Nhvt317bUKcy0te_RR5Duv9p2XFmxDwrj7hPsWjxgy6is-mi3JMDf4wOFUNdIU_QaCDvc Jun 06 21:10:05.464706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:10:05.464706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:10:05.464706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:10:05.464706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:10:05.464706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:10:05.464706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:10:05.464706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: a00a423b890b4dc0b4410220da7cdaa8 Jun 06 21:10:05.464706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesSnapshotTestJSON-342166078 Jun 06 21:10:05.464706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:10:05.464706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:10:05.466340 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a00a423b890b4dc0b4410220da7cdaa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a00a423b890b4dc0b4410220da7cdaa8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a00a423b890b4dc0b4410220da7cdaa8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a00a423b890b4dc0b4410220da7cdaa8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:10:05.466340 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesSnapshotTestJSON-342166078 Jun 06 21:10:05.466340 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: a00a423b890b4dc0b4410220da7cdaa8 Jun 06 21:10:05.466340 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-342166078 Jun 06 21:10:05.466340 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesSnapshotTestJSON-342166078-project Jun 06 21:10:05.466340 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:10:05.466340 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:10:05.466340 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: 3f74038b57aa477283f7c8fabebd19be Jun 06 21:10:05.466340 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesSnapshotTestJSON-342166078-project Jun 06 21:10:05.466340 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: > Jun 06 21:10:05.466340 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Instance 6f153f74-57e8-4d72-9c9d-8b8c03bf7938 could not be found. Jun 06 21:10:05.466340 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '6f153f74-57e8-4d72-9c9d-8b8c03bf7938'} Jun 06 21:10:05.467211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:10:05.467211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:10:05.467211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:10:05.467211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:10:05.467211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:10:05.467211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:10:05.467211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:10:05.467211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:10:05.467211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:10:05.467211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:10:05.467211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f153f74-57e8-4d72-9c9d-8b8c03bf7938 could not be found. Jun 06 21:10:05.467211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:10:05.467211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:10:05.467211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:10:05.467211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:10:05.467211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:10:05.467211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:10:05.467211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:10:05.467211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:10:05.467211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:10:05.468599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:10:05.468599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:10:05.468599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:10:05.468599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:10:05.468599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:10:05.468599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:10:05.468599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:10:05.468599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f153f74-57e8-4d72-9c9d-8b8c03bf7938 could not be found. Jun 06 21:10:05.468599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:10:05.468599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:10:05.468599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:10:05.468599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:10:05.468599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:10:05.468599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:10:05.468599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:10:05.468599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:10:05.468599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f153f74-57e8-4d72-9c9d-8b8c03bf7938 could not be found. Jun 06 21:10:05.468599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:10:05.469743 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-874356ff-11a6-43e1-83de-a962318fc24f tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] Returning 404 to user: Instance 6f153f74-57e8-4d72-9c9d-8b8c03bf7938 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:10:05.469743 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-874356ff-11a6-43e1-83de-a962318fc24f tempest-VolumesSnapshotTestJSON-342166078 tempest-VolumesSnapshotTestJSON-342166078-project] 10.222.0.33 "GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938" status: 404 len: 111 microversion: 2.1 time: 0.045736 Jun 06 21:10:05.469743 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 309/616] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:05 2022] GET /compute/v2.1/servers/6f153f74-57e8-4d72-9c9d-8b8c03bf7938 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:10:05.586049 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-76b29e1a-0708-44d1-bf93-ab94ad2b79d5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:05.593971 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-76b29e1a-0708-44d1-bf93-ab94ad2b79d5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d" status: 200 len: 1681 microversion: 2.1 time: 0.184511 Jun 06 21:10:05.594655 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 308/617] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:05 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:06.266001 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-adc09a15-4c10-4ada-93e6-38b178aa3b0c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:06.266574 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-adc09a15-4c10-4ada-93e6-38b178aa3b0c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:06.273684 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-adc09a15-4c10-4ada-93e6-38b178aa3b0c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:06.274139 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-adc09a15-4c10-4ada-93e6-38b178aa3b0c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:06.274925 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-adc09a15-4c10-4ada-93e6-38b178aa3b0c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:06.275382 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-adc09a15-4c10-4ada-93e6-38b178aa3b0c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:06.418485 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-adc09a15-4c10-4ada-93e6-38b178aa3b0c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:06.427115 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-adc09a15-4c10-4ada-93e6-38b178aa3b0c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1735 microversion: 2.1 time: 0.165062 Jun 06 21:10:06.427694 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 310/618] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:06 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:06.612330 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2ac3fa53-a3ed-462c-831e-4d8357813851 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:06.613159 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-2ac3fa53-a3ed-462c-831e-4d8357813851 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:06.620701 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2ac3fa53-a3ed-462c-831e-4d8357813851 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:06.621152 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2ac3fa53-a3ed-462c-831e-4d8357813851 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:06.621935 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2ac3fa53-a3ed-462c-831e-4d8357813851 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:06.622370 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2ac3fa53-a3ed-462c-831e-4d8357813851 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:06.781164 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2ac3fa53-a3ed-462c-831e-4d8357813851 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:06.792803 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-2ac3fa53-a3ed-462c-831e-4d8357813851 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d" status: 200 len: 1681 microversion: 2.1 time: 0.184656 Jun 06 21:10:06.793400 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 309/619] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:06 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d => generated 1681 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:07.445173 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-dada289a-c08a-426d-9959-b728ecd6655d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:07.445782 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-dada289a-c08a-426d-9959-b728ecd6655d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:07.453178 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dada289a-c08a-426d-9959-b728ecd6655d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:07.453633 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dada289a-c08a-426d-9959-b728ecd6655d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:07.454411 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dada289a-c08a-426d-9959-b728ecd6655d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:07.454848 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dada289a-c08a-426d-9959-b728ecd6655d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:07.608080 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-dada289a-c08a-426d-9959-b728ecd6655d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:07.616723 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-dada289a-c08a-426d-9959-b728ecd6655d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1735 microversion: 2.1 time: 0.175947 Jun 06 21:10:07.617346 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 311/620] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:07 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:07.816771 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-505fe32d-e689-4b46-8902-a040233389b5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:07.817612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-505fe32d-e689-4b46-8902-a040233389b5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:07.825525 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-505fe32d-e689-4b46-8902-a040233389b5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:07.826250 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-505fe32d-e689-4b46-8902-a040233389b5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:07.827089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-505fe32d-e689-4b46-8902-a040233389b5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:07.828224 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-505fe32d-e689-4b46-8902-a040233389b5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:07.929100 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-505fe32d-e689-4b46-8902-a040233389b5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:07.936928 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-505fe32d-e689-4b46-8902-a040233389b5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d" status: 200 len: 1613 microversion: 2.1 time: 0.124121 Jun 06 21:10:07.937526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 310/621] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:07 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d => generated 1613 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:08.124105 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-528428d1-6848-402a-ad93-e0ba6565b548 req-b0d77674-7133-40c9-bca7-8802c42c7185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9fe2313a-d12a-432f-b5b2-4f410f89682d", "name": "network-vif-deleted", "tag": "944d7702-0db4-4e86-9b81-2f64060ac6be"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:10:08.134366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-528428d1-6848-402a-ad93-e0ba6565b548 req-b0d77674-7133-40c9-bca7-8802c42c7185 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:08.134804 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-528428d1-6848-402a-ad93-e0ba6565b548 req-b0d77674-7133-40c9-bca7-8802c42c7185 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:08.146834 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-528428d1-6848-402a-ad93-e0ba6565b548 req-b0d77674-7133-40c9-bca7-8802c42c7185 service nova] Creating event network-vif-deleted:944d7702-0db4-4e86-9b81-2f64060ac6be for instance 9fe2313a-d12a-432f-b5b2-4f410f89682d on hv-cinder-84488 Jun 06 21:10:08.151892 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-528428d1-6848-402a-ad93-e0ba6565b548 req-b0d77674-7133-40c9-bca7-8802c42c7185 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031430 Jun 06 21:10:08.152552 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 312/622] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:10:08.634658 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-9d502b35-b558-45ae-aa8a-802df816cb6e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:08.635325 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-9d502b35-b558-45ae-aa8a-802df816cb6e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:08.642113 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9d502b35-b558-45ae-aa8a-802df816cb6e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:08.642563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9d502b35-b558-45ae-aa8a-802df816cb6e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:08.643374 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9d502b35-b558-45ae-aa8a-802df816cb6e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:08.643811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9d502b35-b558-45ae-aa8a-802df816cb6e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:08.804438 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-9d502b35-b558-45ae-aa8a-802df816cb6e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:08.817501 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-9d502b35-b558-45ae-aa8a-802df816cb6e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1735 microversion: 2.1 time: 0.187091 Jun 06 21:10:08.818179 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 311/623] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:08 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1735 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:08.961689 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-15999927-ff7e-46da-94a7-93b3cea4e3aa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:08.962641 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-15999927-ff7e-46da-94a7-93b3cea4e3aa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:08.969820 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-15999927-ff7e-46da-94a7-93b3cea4e3aa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:08.970267 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-15999927-ff7e-46da-94a7-93b3cea4e3aa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:08.971036 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-15999927-ff7e-46da-94a7-93b3cea4e3aa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:08.971918 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-15999927-ff7e-46da-94a7-93b3cea4e3aa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:09.043429 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-15999927-ff7e-46da-94a7-93b3cea4e3aa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:09.055872 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-15999927-ff7e-46da-94a7-93b3cea4e3aa tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d" status: 200 len: 1325 microversion: 2.1 time: 0.103204 Jun 06 21:10:09.056334 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 313/624] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:08 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d => generated 1325 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:09.836714 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b51177f6-f936-46cf-877f-82ba1d4ca396 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:09.837353 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-b51177f6-f936-46cf-877f-82ba1d4ca396 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:09.844638 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b51177f6-f936-46cf-877f-82ba1d4ca396 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:09.845072 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b51177f6-f936-46cf-877f-82ba1d4ca396 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:09.846077 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b51177f6-f936-46cf-877f-82ba1d4ca396 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:09.846689 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b51177f6-f936-46cf-877f-82ba1d4ca396 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:10.002709 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-b51177f6-f936-46cf-877f-82ba1d4ca396 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:10.011952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-b51177f6-f936-46cf-877f-82ba1d4ca396 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1735 microversion: 2.1 time: 0.179603 Jun 06 21:10:10.012659 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 312/625] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:09 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:10.073505 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fb627f3a-4de6-443a-be35-3616d2f58b1e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:10.074143 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fb627f3a-4de6-443a-be35-3616d2f58b1e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:10.082530 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb627f3a-4de6-443a-be35-3616d2f58b1e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:10.083003 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb627f3a-4de6-443a-be35-3616d2f58b1e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:10.083795 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb627f3a-4de6-443a-be35-3616d2f58b1e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:10.084250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb627f3a-4de6-443a-be35-3616d2f58b1e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:10.128055 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb627f3a-4de6-443a-be35-3616d2f58b1e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:10.128770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb627f3a-4de6-443a-be35-3616d2f58b1e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:10.129524 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-fb627f3a-4de6-443a-be35-3616d2f58b1e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lazy-loading 'fault' on Instance uuid 9fe2313a-d12a-432f-b5b2-4f410f89682d {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:10:10.189831 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fb627f3a-4de6-443a-be35-3616d2f58b1e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:10.204987 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fb627f3a-4de6-443a-be35-3616d2f58b1e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d" status: 200 len: 1330 microversion: 2.1 time: 0.135120 Jun 06 21:10:10.205961 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 314/626] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:10 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d => generated 1330 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:11.032134 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-8a2ea3df-899e-4912-afb6-d0df127486e8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:11.032813 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-8a2ea3df-899e-4912-afb6-d0df127486e8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:11.043218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8a2ea3df-899e-4912-afb6-d0df127486e8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:11.044011 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8a2ea3df-899e-4912-afb6-d0df127486e8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:11.045068 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8a2ea3df-899e-4912-afb6-d0df127486e8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:11.045623 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8a2ea3df-899e-4912-afb6-d0df127486e8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:11.212699 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-8a2ea3df-899e-4912-afb6-d0df127486e8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:11.222385 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-8a2ea3df-899e-4912-afb6-d0df127486e8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1735 microversion: 2.1 time: 0.194880 Jun 06 21:10:11.222995 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 313/627] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:11 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1735 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:11.227657 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7ac5769d-a1b3-4ab5-add3-75602667dddd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:11.228863 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7ac5769d-a1b3-4ab5-add3-75602667dddd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:11.233650 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:10:11.244865 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7ac5769d-a1b3-4ab5-add3-75602667dddd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:11.245666 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7ac5769d-a1b3-4ab5-add3-75602667dddd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:11.247054 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7ac5769d-a1b3-4ab5-add3-75602667dddd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:11.247836 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7ac5769d-a1b3-4ab5-add3-75602667dddd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:11.267669 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-7ac5769d-a1b3-4ab5-add3-75602667dddd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] HTTP exception thrown: Instance 9fe2313a-d12a-432f-b5b2-4f410f89682d could not be found. Jun 06 21:10:11.270260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7ac5769d-a1b3-4ab5-add3-75602667dddd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Request method failure captured: Jun 06 21:10:11.270260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d HTTP/1.1 Jun 06 21:10:11.270260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:10:11.270260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:10:11.270260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:10:11.270260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:10:11.270260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:10:11.270260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:10:11.270260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:10:11.270260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:10:11.270260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinmvxW1bVEWZVhCRlgeG6PDmaOvHpznA6mf68h7fAFngISNh4GnD9XFqvo52ymtA4PTaTSN-lCxDTYk7dFVIPU5elkSuX6Hf8rm-_SR1iR7N3wUEkc6KR6wmwlcMFMA3l3v8mmff7I1soQTiyS_qgppqz32gWX7gOKmiYav_WF1YU4TA Jun 06 21:10:11.270260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:10:11.270260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:10:11.270260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:10:11.270260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:10:11.270260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:10:11.270260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:10:11.270260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:10:11.270260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:10:11.270260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:10:11.270260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:10:11.272921 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:10:11.272921 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:10:11.272921 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:10:11.272921 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:10:11.272921 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:10:11.272921 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:10:11.272921 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:10:11.272921 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: 8713cb23a93147f8b52f88e240c81d6f Jun 06 21:10:11.272921 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:10:11.272921 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: > Jun 06 21:10:11.272921 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Instance 9fe2313a-d12a-432f-b5b2-4f410f89682d could not be found. Jun 06 21:10:11.272921 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '9fe2313a-d12a-432f-b5b2-4f410f89682d'} Jun 06 21:10:11.274609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:10:11.274609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:10:11.274609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:10:11.274609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:10:11.274609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:10:11.274609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:10:11.274609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:10:11.274609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:10:11.274609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:10:11.274609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:10:11.274609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fe2313a-d12a-432f-b5b2-4f410f89682d could not be found. Jun 06 21:10:11.274609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:10:11.274609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:10:11.274609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:10:11.274609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:10:11.274609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:10:11.274609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:10:11.274609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:10:11.274609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:10:11.274609 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:10:11.277498 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:10:11.277498 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:10:11.277498 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:10:11.277498 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:10:11.277498 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:10:11.277498 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:10:11.277498 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:10:11.277498 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fe2313a-d12a-432f-b5b2-4f410f89682d could not be found. Jun 06 21:10:11.277498 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:10:11.277498 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:10:11.277498 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:10:11.277498 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:10:11.277498 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:10:11.277498 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:10:11.277498 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:10:11.277498 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:10:11.277498 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fe2313a-d12a-432f-b5b2-4f410f89682d could not be found. Jun 06 21:10:11.277498 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:10:11.279826 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7ac5769d-a1b3-4ab5-add3-75602667dddd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Returning 404 to user: Instance 9fe2313a-d12a-432f-b5b2-4f410f89682d could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:10:11.279826 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7ac5769d-a1b3-4ab5-add3-75602667dddd tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d" status: 404 len: 111 microversion: 2.1 time: 0.051304 Jun 06 21:10:11.279826 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 315/628] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:11 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:10:11.284542 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-beda6ada-d1ba-4764-8ca4-e94a13c0386d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '.version_select at 0x7f2725e3e700>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:11.305465 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-beda6ada-d1ba-4764-8ca4-e94a13c0386d tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-859659914" status: 202 len: 0 microversion: 2.1 time: 0.025953 Jun 06 21:10:11.306030 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 314/629] 10.222.0.33 () {58 vars in 1217 bytes} [Mon Jun 6 21:10:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-859659914 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:10:12.121917 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2827e646-52eb-4752-9caa-fa3acf3b0d48 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Action: 'create', calling method: .version_select at 0x7f27257349d0>, body: {"keypair": {"name": "tempest-keypair-1466420993", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP+oJRVs7cJcbnIemcTK+6kTJ7jivzlVre84ZlQy6HTEvBm4bVj4KP/C16LlVvOHf2KGLxGg1WWnvakbO/wOqYAD9KKMJEcljuFMOc5hvQODg4cNsMRUIlMkjnGTZhKVqw=="}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:10:12.139010 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-2827e646-52eb-4752-9caa-fa3acf3b0d48 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Getting quotas for project 5a771f1ab27f40aca2d546901cdcecda. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:10:12.144516 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-2827e646-52eb-4752-9caa-fa3acf3b0d48 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Getting quotas for user 8713cb23a93147f8b52f88e240c81d6f and project 5a771f1ab27f40aca2d546901cdcecda. Resources: {'key_pairs'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:10:12.173860 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2827e646-52eb-4752-9caa-fa3acf3b0d48 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056117 Jun 06 21:10:12.174631 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 316/630] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jun 6 21:10:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:10:12.243384 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-290f78d2-a613-44ae-8846-fe3e2d61c367 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:12.244310 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-290f78d2-a613-44ae-8846-fe3e2d61c367 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:12.247068 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:10:12.254211 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-290f78d2-a613-44ae-8846-fe3e2d61c367 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:12.254661 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-290f78d2-a613-44ae-8846-fe3e2d61c367 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:12.255453 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-290f78d2-a613-44ae-8846-fe3e2d61c367 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:12.255880 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-290f78d2-a613-44ae-8846-fe3e2d61c367 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:12.421707 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-290f78d2-a613-44ae-8846-fe3e2d61c367 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:12.433092 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-290f78d2-a613-44ae-8846-fe3e2d61c367 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1735 microversion: 2.1 time: 0.195535 Jun 06 21:10:12.433694 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 315/631] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:12 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:10:13.456436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f073a232-34c5-4da1-ab49-7b8f5e1544a3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:13.457510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f073a232-34c5-4da1-ab49-7b8f5e1544a3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:13.470416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f073a232-34c5-4da1-ab49-7b8f5e1544a3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:13.471468 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f073a232-34c5-4da1-ab49-7b8f5e1544a3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:13.482689 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f073a232-34c5-4da1-ab49-7b8f5e1544a3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:13.483198 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f073a232-34c5-4da1-ab49-7b8f5e1544a3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:13.751651 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f073a232-34c5-4da1-ab49-7b8f5e1544a3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:13.761042 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f073a232-34c5-4da1-ab49-7b8f5e1544a3 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1735 microversion: 2.1 time: 0.313350 Jun 06 21:10:13.761657 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 317/632] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:13 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1735 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:13.965584 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-ebba236e-85b1-4fde-a7a3-60fca99e34c3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1297406211", "imageRef": "e4266a01-7d22-4036-91e8-3ec50e3369c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "caa56bb2-4a47-4aeb-99db-1e89b9e32e70"}], "security_groups": [{"name": "tempest-securitygroup--677359387"}], "key_name": "tempest-keypair-1466420993", "user_data": "}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:10:14.092139 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.network.neutron [None req-ebba236e-85b1-4fde-a7a3-60fca99e34c3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] validate_networks() for [('caa56bb2-4a47-4aeb-99db-1e89b9e32e70', None, None, None, None, None)] {{(pid=117860) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 21:10:14.598304 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-ebba236e-85b1-4fde-a7a3-60fca99e34c3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Flavor limits 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 21:10:14.598727 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-ebba236e-85b1-4fde-a7a3-60fca99e34c3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Image limits 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 21:10:14.599197 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-ebba236e-85b1-4fde-a7a3-60fca99e34c3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Flavor pref 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 21:10:14.599599 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-ebba236e-85b1-4fde-a7a3-60fca99e34c3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Image pref 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 21:10:14.600039 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-ebba236e-85b1-4fde-a7a3-60fca99e34c3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 21:10:14.609686 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ebba236e-85b1-4fde-a7a3-60fca99e34c3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:14.610124 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ebba236e-85b1-4fde-a7a3-60fca99e34c3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:14.610932 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ebba236e-85b1-4fde-a7a3-60fca99e34c3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:14.611447 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ebba236e-85b1-4fde-a7a3-60fca99e34c3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:14.630176 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-ebba236e-85b1-4fde-a7a3-60fca99e34c3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Getting quotas for project 5a771f1ab27f40aca2d546901cdcecda. Resources: {'ram', 'cores', 'instances'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:10:14.634492 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-ebba236e-85b1-4fde-a7a3-60fca99e34c3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Getting quotas for user 8713cb23a93147f8b52f88e240c81d6f and project 5a771f1ab27f40aca2d546901cdcecda. Resources: {'ram', 'cores', 'instances'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:10:14.646619 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-ebba236e-85b1-4fde-a7a3-60fca99e34c3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Going to run 1 instances... {{(pid=117860) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 21:10:14.648969 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-ebba236e-85b1-4fde-a7a3-60fca99e34c3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4266a01-7d22-4036-91e8-3ec50e3369c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 21:10:14.709727 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-ebba236e-85b1-4fde-a7a3-60fca99e34c3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.748562 Jun 06 21:10:14.710595 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 316/633] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 6 21:10:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 21:10:14.720832 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0991a7ff-4242-41bd-91c7-0d52eabbef4f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:14.721514 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0991a7ff-4242-41bd-91c7-0d52eabbef4f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:14.781474 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-3a1d62ff-d93f-4699-82c6-136de4477284 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:14.782087 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-3a1d62ff-d93f-4699-82c6-136de4477284 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:14.785889 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0991a7ff-4242-41bd-91c7-0d52eabbef4f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:14.790563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3a1d62ff-d93f-4699-82c6-136de4477284 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:14.792746 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3a1d62ff-d93f-4699-82c6-136de4477284 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:14.792746 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3a1d62ff-d93f-4699-82c6-136de4477284 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:14.792746 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3a1d62ff-d93f-4699-82c6-136de4477284 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:14.795827 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0991a7ff-4242-41bd-91c7-0d52eabbef4f tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab" status: 200 len: 1242 microversion: 2.1 time: 0.078848 Jun 06 21:10:14.798920 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 318/634] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:14 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:14.968877 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-3a1d62ff-d93f-4699-82c6-136de4477284 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:14.979494 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-3a1d62ff-d93f-4699-82c6-136de4477284 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1735 microversion: 2.1 time: 0.202650 Jun 06 21:10:14.980104 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 317/635] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:14 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:10:15.814549 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-afc62bd9-0efe-41ac-9815-da32856d14f2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:15.819067 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-afc62bd9-0efe-41ac-9815-da32856d14f2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:15.838710 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-afc62bd9-0efe-41ac-9815-da32856d14f2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:15.839523 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-afc62bd9-0efe-41ac-9815-da32856d14f2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:15.841325 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-afc62bd9-0efe-41ac-9815-da32856d14f2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:15.842304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-afc62bd9-0efe-41ac-9815-da32856d14f2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:15.927512 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-afc62bd9-0efe-41ac-9815-da32856d14f2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:15.939549 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-afc62bd9-0efe-41ac-9815-da32856d14f2 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab" status: 200 len: 1246 microversion: 2.1 time: 0.128881 Jun 06 21:10:15.941287 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 319/636] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:15 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab => generated 1246 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:16.004861 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-c8f6b2a0-f003-47f2-841b-28a808707c1e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:16.005713 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-c8f6b2a0-f003-47f2-841b-28a808707c1e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:16.013299 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c8f6b2a0-f003-47f2-841b-28a808707c1e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:16.013855 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c8f6b2a0-f003-47f2-841b-28a808707c1e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:16.015090 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c8f6b2a0-f003-47f2-841b-28a808707c1e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:16.015549 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c8f6b2a0-f003-47f2-841b-28a808707c1e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:16.039688 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:10:16.204798 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c8f6b2a0-f003-47f2-841b-28a808707c1e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:16.213629 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-c8f6b2a0-f003-47f2-841b-28a808707c1e tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1735 microversion: 2.1 time: 0.212876 Jun 06 21:10:16.214227 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 318/637] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:15 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:16.965510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-636ff241-bc8d-46eb-bfd0-cdac4cc6b291 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:16.966422 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-636ff241-bc8d-46eb-bfd0-cdac4cc6b291 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:16.976257 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-636ff241-bc8d-46eb-bfd0-cdac4cc6b291 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:16.976847 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-636ff241-bc8d-46eb-bfd0-cdac4cc6b291 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:16.977688 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-636ff241-bc8d-46eb-bfd0-cdac4cc6b291 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:16.978165 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-636ff241-bc8d-46eb-bfd0-cdac4cc6b291 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:17.067736 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-636ff241-bc8d-46eb-bfd0-cdac4cc6b291 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:17.077718 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-636ff241-bc8d-46eb-bfd0-cdac4cc6b291 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab" status: 200 len: 1246 microversion: 2.1 time: 0.115991 Jun 06 21:10:17.078352 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 320/638] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:16 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab => generated 1246 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:17.234842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e5f3e1a6-79b4-4ba1-876a-ec0e64763756 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:17.235442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-e5f3e1a6-79b4-4ba1-876a-ec0e64763756 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:17.243968 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e5f3e1a6-79b4-4ba1-876a-ec0e64763756 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:17.244453 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e5f3e1a6-79b4-4ba1-876a-ec0e64763756 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:17.245272 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e5f3e1a6-79b4-4ba1-876a-ec0e64763756 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:17.245704 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e5f3e1a6-79b4-4ba1-876a-ec0e64763756 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:17.393112 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e5f3e1a6-79b4-4ba1-876a-ec0e64763756 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:17.402551 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-e5f3e1a6-79b4-4ba1-876a-ec0e64763756 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1735 microversion: 2.1 time: 0.171788 Jun 06 21:10:17.403166 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 319/639] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:17 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:18.096430 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-05363a5c-0e3c-4333-9426-454a8f0f8ae8 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:18.097103 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-05363a5c-0e3c-4333-9426-454a8f0f8ae8 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:18.104080 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-05363a5c-0e3c-4333-9426-454a8f0f8ae8 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:18.104574 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-05363a5c-0e3c-4333-9426-454a8f0f8ae8 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:18.105388 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-05363a5c-0e3c-4333-9426-454a8f0f8ae8 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:18.105858 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-05363a5c-0e3c-4333-9426-454a8f0f8ae8 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:18.190336 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-05363a5c-0e3c-4333-9426-454a8f0f8ae8 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:18.199959 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-05363a5c-0e3c-4333-9426-454a8f0f8ae8 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab" status: 200 len: 1294 microversion: 2.1 time: 0.107432 Jun 06 21:10:18.200744 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 321/640] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:18 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab => generated 1294 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:18.424571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-466607b4-c60a-4ace-bc54-db34b8733ea1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:18.425704 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-466607b4-c60a-4ace-bc54-db34b8733ea1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:18.437211 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-466607b4-c60a-4ace-bc54-db34b8733ea1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:18.437857 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-466607b4-c60a-4ace-bc54-db34b8733ea1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:18.439015 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-466607b4-c60a-4ace-bc54-db34b8733ea1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:18.439648 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-466607b4-c60a-4ace-bc54-db34b8733ea1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:19.019272 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-466607b4-c60a-4ace-bc54-db34b8733ea1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:19.031942 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-466607b4-c60a-4ace-bc54-db34b8733ea1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1715 microversion: 2.1 time: 0.613866 Jun 06 21:10:19.032901 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 320/641] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:18 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1715 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:19.104126 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a842d72a-4cb5-4606-9547-a1f168591a9b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:19.104733 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a842d72a-4cb5-4606-9547-a1f168591a9b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:19.111367 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a842d72a-4cb5-4606-9547-a1f168591a9b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:19.112021 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a842d72a-4cb5-4606-9547-a1f168591a9b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:19.112884 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a842d72a-4cb5-4606-9547-a1f168591a9b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:19.113411 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a842d72a-4cb5-4606-9547-a1f168591a9b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:19.219267 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-5f36998c-3acf-4abf-9e86-6cc470c779f4 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:19.220202 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-5f36998c-3acf-4abf-9e86-6cc470c779f4 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:19.228124 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:10:19.233454 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-a842d72a-4cb5-4606-9547-a1f168591a9b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] HTTP exception thrown: Cannot 'detach_volume' instance a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 while it is in vm_state rescued Jun 06 21:10:19.235542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a842d72a-4cb5-4606-9547-a1f168591a9b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Request method failure captured: Jun 06 21:10:19.235542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: DELETE /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1/os-volume_attachments/9b5dcf79-34f5-4bf0-a6a2-7e482687fdcb HTTP/1.1 Jun 06 21:10:19.235542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:10:19.235542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:10:19.235542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:10:19.235542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:10:19.235542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:10:19.235542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:10:19.235542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:10:19.235542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:10:19.235542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinmw5kgLR6NMd10ofnxehsGJrZH5eihmOg4VV2rlqBjZwvfhUx8kow_T1NaOr6zNm6K1jJsuYEhS0J5QDngP2LhFXAmzwJ6InRv6t8Nhyq76ejvBrCHdAnd0U1eHtmfrOhv9AMEP1mJ0K9M-NNm9AUbkBVRKPRAi4NyD11SlCUna2Q5g Jun 06 21:10:19.235542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:10:19.235542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:10:19.235542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:10:19.235542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:10:19.235542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:10:19.235542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:10:19.235542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: f0246519bc2240cf8d1ba54172c0faca Jun 06 21:10:19.235542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-615855304 Jun 06 21:10:19.235542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:10:19.235542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:10:19.237231 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0246519bc2240cf8d1ba54172c0faca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f0246519bc2240cf8d1ba54172c0faca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f0246519bc2240cf8d1ba54172c0faca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0246519bc2240cf8d1ba54172c0faca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:10:19.237231 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-ServerRescueNegativeTestJSON-615855304 Jun 06 21:10:19.237231 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: f0246519bc2240cf8d1ba54172c0faca Jun 06 21:10:19.237231 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-615855304 Jun 06 21:10:19.237231 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-ServerRescueNegativeTestJSON-615855304-project Jun 06 21:10:19.237231 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:10:19.237231 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:10:19.237231 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: ab9da673f40b4e3eb541fdc380cfe282 Jun 06 21:10:19.237231 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-ServerRescueNegativeTestJSON-615855304-project Jun 06 21:10:19.237231 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: > Jun 06 21:10:19.237231 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Cannot 'detach_volume' instance a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 while it is in vm_state rescued Jun 06 21:10:19.237942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'server_id': 'a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1', 'id': '9b5dcf79-34f5-4bf0-a6a2-7e482687fdcb'} Jun 06 21:10:19.237942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:10:19.237942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:10:19.237942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 06 21:10:19.237942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 06 21:10:19.237942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 21:10:19.237942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 21:10:19.237942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 06 21:10:19.237942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 06 21:10:19.237942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 06 21:10:19.237942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:10:19.237942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:10:19.237942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:10:19.237942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:10:19.237942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:10:19.237942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:10:19.237942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:10:19.237942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:10:19.237942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:10:19.237942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:10:19.239276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 06 21:10:19.239276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 06 21:10:19.239276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 06 21:10:19.239276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 06 21:10:19.239276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 while it is in vm_state rescued Jun 06 21:10:19.239276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:10:19.239276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:10:19.239276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:10:19.239276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:10:19.239276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:10:19.239276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:10:19.239276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:10:19.239276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:10:19.239276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 while it is in vm_state rescued Jun 06 21:10:19.239276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:10:19.241192 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a842d72a-4cb5-4606-9547-a1f168591a9b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Returning 409 to user: Cannot 'detach_volume' instance a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 while it is in vm_state rescued {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:10:19.241786 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5f36998c-3acf-4abf-9e86-6cc470c779f4 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:19.242413 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a842d72a-4cb5-4606-9547-a1f168591a9b tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1/os-volume_attachments/9b5dcf79-34f5-4bf0-a6a2-7e482687fdcb" status: 409 len: 152 microversion: 2.1 time: 0.142435 Jun 06 21:10:19.242572 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5f36998c-3acf-4abf-9e86-6cc470c779f4 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:19.243397 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5f36998c-3acf-4abf-9e86-6cc470c779f4 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:19.243933 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5f36998c-3acf-4abf-9e86-6cc470c779f4 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:19.244118 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 322/642] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 6 21:10:19 2022] DELETE /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1/os-volume_attachments/9b5dcf79-34f5-4bf0-a6a2-7e482687fdcb => generated 152 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 06 21:10:19.266693 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1f64b863-d618-487f-b7d7-b81297465c5f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:10:19.268470 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1f64b863-d618-487f-b7d7-b81297465c5f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:19.277646 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1f64b863-d618-487f-b7d7-b81297465c5f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:19.278908 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1f64b863-d618-487f-b7d7-b81297465c5f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:19.280130 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1f64b863-d618-487f-b7d7-b81297465c5f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:19.280842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1f64b863-d618-487f-b7d7-b81297465c5f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:19.360167 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1f64b863-d618-487f-b7d7-b81297465c5f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "POST /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1/action" status: 202 len: 0 microversion: 2.1 time: 0.100013 Jun 06 21:10:19.360841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 323/643] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 6 21:10:19 2022] POST /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:10:19.377132 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-5f36998c-3acf-4abf-9e86-6cc470c779f4 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:19.385601 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fb0be621-0520-49c4-ae95-1467a07d63d5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:19.386453 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fb0be621-0520-49c4-ae95-1467a07d63d5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:19.392861 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-5f36998c-3acf-4abf-9e86-6cc470c779f4 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab" status: 200 len: 1300 microversion: 2.1 time: 0.177388 Jun 06 21:10:19.393499 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 321/644] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:19 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab => generated 1300 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:10:19.403628 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb0be621-0520-49c4-ae95-1467a07d63d5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:19.404460 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb0be621-0520-49c4-ae95-1467a07d63d5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:19.405836 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb0be621-0520-49c4-ae95-1467a07d63d5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:19.406629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fb0be621-0520-49c4-ae95-1467a07d63d5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:19.595873 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fb0be621-0520-49c4-ae95-1467a07d63d5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:19.607553 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fb0be621-0520-49c4-ae95-1467a07d63d5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1723 microversion: 2.1 time: 0.238445 Jun 06 21:10:19.616347 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 324/645] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:19 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:20.412204 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-dfa2722a-2634-4f07-a6e2-dd2f2c931ec3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:20.413048 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-dfa2722a-2634-4f07-a6e2-dd2f2c931ec3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:20.425466 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-dfa2722a-2634-4f07-a6e2-dd2f2c931ec3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:20.425988 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-dfa2722a-2634-4f07-a6e2-dd2f2c931ec3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:20.427050 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-dfa2722a-2634-4f07-a6e2-dd2f2c931ec3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:20.427493 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-dfa2722a-2634-4f07-a6e2-dd2f2c931ec3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:20.639692 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-eabb672e-467b-4a87-8dfd-2af35b415d66 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:20.640697 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-eabb672e-467b-4a87-8dfd-2af35b415d66 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:20.653079 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eabb672e-467b-4a87-8dfd-2af35b415d66 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:20.653842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eabb672e-467b-4a87-8dfd-2af35b415d66 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:20.655238 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eabb672e-467b-4a87-8dfd-2af35b415d66 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:20.656090 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-eabb672e-467b-4a87-8dfd-2af35b415d66 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:20.694911 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-dfa2722a-2634-4f07-a6e2-dd2f2c931ec3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:20.711962 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-dfa2722a-2634-4f07-a6e2-dd2f2c931ec3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab" status: 200 len: 1367 microversion: 2.1 time: 0.304052 Jun 06 21:10:20.713568 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 322/646] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:20 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab => generated 1367 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:20.884118 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-eabb672e-467b-4a87-8dfd-2af35b415d66 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:20.900248 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-eabb672e-467b-4a87-8dfd-2af35b415d66 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1723 microversion: 2.1 time: 0.267552 Jun 06 21:10:20.901024 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 325/647] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:20 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1723 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:21.149551 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-41326085-e79d-4734-bc4e-6e43c7b86382 req-e8f90bc9-b4e8-4e64-b080-8d6b79b361c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab", "tag": "15c41403-c077-4ee6-a769-5c89f46790c6"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:10:21.163854 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-41326085-e79d-4734-bc4e-6e43c7b86382 req-e8f90bc9-b4e8-4e64-b080-8d6b79b361c6 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:21.165075 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-41326085-e79d-4734-bc4e-6e43c7b86382 req-e8f90bc9-b4e8-4e64-b080-8d6b79b361c6 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:21.183015 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-41326085-e79d-4734-bc4e-6e43c7b86382 req-e8f90bc9-b4e8-4e64-b080-8d6b79b361c6 service nova] Creating event network-changed:15c41403-c077-4ee6-a769-5c89f46790c6 for instance 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab on hv-cinder-84488 Jun 06 21:10:21.188593 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-41326085-e79d-4734-bc4e-6e43c7b86382 req-e8f90bc9-b4e8-4e64-b080-8d6b79b361c6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046134 Jun 06 21:10:21.189634 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 323/648] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:10:21.731107 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c8b5fff8-6432-417b-969c-9ced1b1ddfbb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:21.731855 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c8b5fff8-6432-417b-969c-9ced1b1ddfbb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:21.740965 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8b5fff8-6432-417b-969c-9ced1b1ddfbb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:21.741525 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8b5fff8-6432-417b-969c-9ced1b1ddfbb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:21.742597 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8b5fff8-6432-417b-969c-9ced1b1ddfbb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:21.743347 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8b5fff8-6432-417b-969c-9ced1b1ddfbb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:21.900887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c8b5fff8-6432-417b-969c-9ced1b1ddfbb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:21.910003 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c8b5fff8-6432-417b-969c-9ced1b1ddfbb tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab" status: 200 len: 1367 microversion: 2.1 time: 0.182947 Jun 06 21:10:21.910596 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 326/649] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:21 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:21.920819 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-842cae31-197a-4595-944f-6d7ee632d3a9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:21.921521 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-842cae31-197a-4595-944f-6d7ee632d3a9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:21.928926 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-842cae31-197a-4595-944f-6d7ee632d3a9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:21.929370 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-842cae31-197a-4595-944f-6d7ee632d3a9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:21.930147 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-842cae31-197a-4595-944f-6d7ee632d3a9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:21.930573 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-842cae31-197a-4595-944f-6d7ee632d3a9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:22.143109 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-842cae31-197a-4595-944f-6d7ee632d3a9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:22.151535 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-842cae31-197a-4595-944f-6d7ee632d3a9 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1723 microversion: 2.1 time: 0.235611 Jun 06 21:10:22.152146 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 324/650] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:21 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:22.939200 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-536e68e5-6db2-453f-b01f-f9e05bbc78b7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:22.939877 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-536e68e5-6db2-453f-b01f-f9e05bbc78b7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:22.947274 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-536e68e5-6db2-453f-b01f-f9e05bbc78b7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:22.947677 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-536e68e5-6db2-453f-b01f-f9e05bbc78b7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:22.948481 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-536e68e5-6db2-453f-b01f-f9e05bbc78b7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:22.948992 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-536e68e5-6db2-453f-b01f-f9e05bbc78b7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:23.125783 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-536e68e5-6db2-453f-b01f-f9e05bbc78b7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:23.135561 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-536e68e5-6db2-453f-b01f-f9e05bbc78b7 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab" status: 200 len: 1367 microversion: 2.1 time: 0.205645 Jun 06 21:10:23.136476 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 327/651] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:22 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:23.169488 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-dce8a57a-0240-4bfa-b731-f30a3c27d6c8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:23.170380 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-dce8a57a-0240-4bfa-b731-f30a3c27d6c8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:23.178256 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-dce8a57a-0240-4bfa-b731-f30a3c27d6c8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:23.178835 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-dce8a57a-0240-4bfa-b731-f30a3c27d6c8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:23.179695 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-dce8a57a-0240-4bfa-b731-f30a3c27d6c8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:23.180224 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-dce8a57a-0240-4bfa-b731-f30a3c27d6c8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:23.352971 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-dce8a57a-0240-4bfa-b731-f30a3c27d6c8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:23.361757 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-dce8a57a-0240-4bfa-b731-f30a3c27d6c8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1729 microversion: 2.1 time: 0.196597 Jun 06 21:10:23.362453 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 325/652] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:23 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:23.381885 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-76237497-43bd-409b-8fda-85af38f1438c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:23.382384 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-76237497-43bd-409b-8fda-85af38f1438c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:23.388786 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76237497-43bd-409b-8fda-85af38f1438c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:23.389245 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76237497-43bd-409b-8fda-85af38f1438c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:23.390020 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76237497-43bd-409b-8fda-85af38f1438c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:23.390457 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-76237497-43bd-409b-8fda-85af38f1438c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:23.481472 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-76237497-43bd-409b-8fda-85af38f1438c tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102923 Jun 06 21:10:23.482290 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 328/653] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jun 6 21:10:23 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:10:24.162180 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-1fbea006-ace3-4fb8-8804-908b1e5e7a42 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:24.162912 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-1fbea006-ace3-4fb8-8804-908b1e5e7a42 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:24.169220 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1fbea006-ace3-4fb8-8804-908b1e5e7a42 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:24.169663 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1fbea006-ace3-4fb8-8804-908b1e5e7a42 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:24.170424 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1fbea006-ace3-4fb8-8804-908b1e5e7a42 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:24.170852 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1fbea006-ace3-4fb8-8804-908b1e5e7a42 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:24.308139 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-1fbea006-ace3-4fb8-8804-908b1e5e7a42 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:24.317362 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-1fbea006-ace3-4fb8-8804-908b1e5e7a42 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab" status: 200 len: 1367 microversion: 2.1 time: 0.159930 Jun 06 21:10:24.318242 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 326/654] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:24 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:10:24.598986 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-9cd1f22e-78a0-4191-8321-559e61061b78 req-a1b596fe-58d8-4e0f-a5fb-8ce883bd1668 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1", "tag": "bde81077-0263-4b2a-91eb-97a7fd73212f"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:10:24.607723 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-9cd1f22e-78a0-4191-8321-559e61061b78 req-a1b596fe-58d8-4e0f-a5fb-8ce883bd1668 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:24.608190 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-9cd1f22e-78a0-4191-8321-559e61061b78 req-a1b596fe-58d8-4e0f-a5fb-8ce883bd1668 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:24.620426 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-9cd1f22e-78a0-4191-8321-559e61061b78 req-a1b596fe-58d8-4e0f-a5fb-8ce883bd1668 service nova] Creating event network-changed:bde81077-0263-4b2a-91eb-97a7fd73212f for instance a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 on hv-cinder-84488 Jun 06 21:10:24.625449 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-9cd1f22e-78a0-4191-8321-559e61061b78 req-a1b596fe-58d8-4e0f-a5fb-8ce883bd1668 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099510 Jun 06 21:10:24.626068 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 329/655] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:10:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:10:25.335930 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-a87d0aee-b41e-436a-afad-95e023ebb2c1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:25.336996 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-a87d0aee-b41e-436a-afad-95e023ebb2c1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:25.340643 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=2 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:10:25.341573 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=6 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:10:25.348500 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a87d0aee-b41e-436a-afad-95e023ebb2c1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:25.349075 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a87d0aee-b41e-436a-afad-95e023ebb2c1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:25.349955 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a87d0aee-b41e-436a-afad-95e023ebb2c1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:25.350595 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a87d0aee-b41e-436a-afad-95e023ebb2c1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:25.512603 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-a87d0aee-b41e-436a-afad-95e023ebb2c1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:25.521646 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-a87d0aee-b41e-436a-afad-95e023ebb2c1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab" status: 200 len: 1367 microversion: 2.1 time: 0.190794 Jun 06 21:10:25.522240 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 327/656] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:25 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:26.536298 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=6 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:10:26.541654 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d20d307d-cfcb-4753-8658-d3224a6564a5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:26.542393 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d20d307d-cfcb-4753-8658-d3224a6564a5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:26.550057 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d20d307d-cfcb-4753-8658-d3224a6564a5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:26.550501 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d20d307d-cfcb-4753-8658-d3224a6564a5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:26.551440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d20d307d-cfcb-4753-8658-d3224a6564a5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:26.552083 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d20d307d-cfcb-4753-8658-d3224a6564a5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:26.645791 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-ae8a0b4a-a36f-4637-a4ba-1e48a8b1f99e req-75dbf0c2-792c-4bd7-9773-fd09110862a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1", "tag": "bde81077-0263-4b2a-91eb-97a7fd73212f"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:10:26.661663 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-ae8a0b4a-a36f-4637-a4ba-1e48a8b1f99e req-75dbf0c2-792c-4bd7-9773-fd09110862a6 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:26.662464 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-ae8a0b4a-a36f-4637-a4ba-1e48a8b1f99e req-75dbf0c2-792c-4bd7-9773-fd09110862a6 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:26.680820 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-ae8a0b4a-a36f-4637-a4ba-1e48a8b1f99e req-75dbf0c2-792c-4bd7-9773-fd09110862a6 service nova] Creating event network-changed:bde81077-0263-4b2a-91eb-97a7fd73212f for instance a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 on hv-cinder-84488 Jun 06 21:10:26.686194 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-ae8a0b4a-a36f-4637-a4ba-1e48a8b1f99e req-75dbf0c2-792c-4bd7-9773-fd09110862a6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045923 Jun 06 21:10:26.687022 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 328/657] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:10:26.713322 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d20d307d-cfcb-4753-8658-d3224a6564a5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:26.721289 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d20d307d-cfcb-4753-8658-d3224a6564a5 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab" status: 200 len: 1367 microversion: 2.1 time: 0.185718 Jun 06 21:10:26.721870 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 330/658] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:26 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:27.740828 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-70772084-cb47-4c1b-8515-61560a700622 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:27.741756 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-70772084-cb47-4c1b-8515-61560a700622 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:27.749877 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-70772084-cb47-4c1b-8515-61560a700622 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:27.750332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-70772084-cb47-4c1b-8515-61560a700622 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:27.751098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-70772084-cb47-4c1b-8515-61560a700622 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:27.751535 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-70772084-cb47-4c1b-8515-61560a700622 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:27.934816 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-70772084-cb47-4c1b-8515-61560a700622 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:27.944226 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-70772084-cb47-4c1b-8515-61560a700622 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab" status: 200 len: 1367 microversion: 2.1 time: 0.208749 Jun 06 21:10:27.944835 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 329/659] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:27 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab => generated 1367 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:28.137133 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-871db877-3a1e-4a09-a1c5-2f6672f3f11c req-cdc2289d-357f-4c92-b330-9656b8fe3c34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab", "name": "network-vif-plugged", "status": "completed", "tag": "15c41403-c077-4ee6-a769-5c89f46790c6"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:10:28.146925 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-871db877-3a1e-4a09-a1c5-2f6672f3f11c req-cdc2289d-357f-4c92-b330-9656b8fe3c34 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:28.147362 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-871db877-3a1e-4a09-a1c5-2f6672f3f11c req-cdc2289d-357f-4c92-b330-9656b8fe3c34 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:28.161013 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-871db877-3a1e-4a09-a1c5-2f6672f3f11c req-cdc2289d-357f-4c92-b330-9656b8fe3c34 service nova] Creating event network-vif-plugged:15c41403-c077-4ee6-a769-5c89f46790c6 for instance 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab on hv-cinder-84488 Jun 06 21:10:28.166878 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-871db877-3a1e-4a09-a1c5-2f6672f3f11c req-cdc2289d-357f-4c92-b330-9656b8fe3c34 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119034 Jun 06 21:10:28.167491 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 331/660] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:10:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:10:28.295183 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b1fc34fb-5d6b-4053-8bd7-2adc4f87c58d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:28.295701 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-b1fc34fb-5d6b-4053-8bd7-2adc4f87c58d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:28.302820 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b1fc34fb-5d6b-4053-8bd7-2adc4f87c58d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:28.303155 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b1fc34fb-5d6b-4053-8bd7-2adc4f87c58d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:28.303940 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b1fc34fb-5d6b-4053-8bd7-2adc4f87c58d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:28.304388 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b1fc34fb-5d6b-4053-8bd7-2adc4f87c58d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:28.332683 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-b1fc34fb-5d6b-4053-8bd7-2adc4f87c58d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2/ips" status: 200 len: 151 microversion: 2.20 time: 0.117115 Jun 06 21:10:28.333370 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 330/661] 10.222.0.33 () {60 vars in 1288 bytes} [Mon Jun 6 21:10:28 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2/ips => generated 151 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 21:10:28.964374 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-cfcff00f-6518-4ab4-85c7-e8be8dd1a2f6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:28.965866 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-cfcff00f-6518-4ab4-85c7-e8be8dd1a2f6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:28.973962 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cfcff00f-6518-4ab4-85c7-e8be8dd1a2f6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:28.974537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cfcff00f-6518-4ab4-85c7-e8be8dd1a2f6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:28.975380 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cfcff00f-6518-4ab4-85c7-e8be8dd1a2f6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:28.975880 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cfcff00f-6518-4ab4-85c7-e8be8dd1a2f6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:29.141983 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-cfcff00f-6518-4ab4-85c7-e8be8dd1a2f6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:29.153236 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-cfcff00f-6518-4ab4-85c7-e8be8dd1a2f6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab" status: 200 len: 1367 microversion: 2.1 time: 0.194423 Jun 06 21:10:29.153894 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 332/662] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:28 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:30.174039 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-ee66fb8c-d2cd-4504-8569-48bfa75db42c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:30.175068 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-ee66fb8c-d2cd-4504-8569-48bfa75db42c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:30.182672 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ee66fb8c-d2cd-4504-8569-48bfa75db42c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:30.183231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ee66fb8c-d2cd-4504-8569-48bfa75db42c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:30.184318 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ee66fb8c-d2cd-4504-8569-48bfa75db42c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:30.184874 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ee66fb8c-d2cd-4504-8569-48bfa75db42c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:30.370911 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-ee66fb8c-d2cd-4504-8569-48bfa75db42c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:30.381286 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-ee66fb8c-d2cd-4504-8569-48bfa75db42c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab" status: 200 len: 1367 microversion: 2.1 time: 0.211170 Jun 06 21:10:30.382015 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 331/663] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:30 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:30.772750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fd5e4f86-e87c-4da5-be93-c8b73ee02e14 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:10:30.773365 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fd5e4f86-e87c-4da5-be93-c8b73ee02e14 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:30.780995 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fd5e4f86-e87c-4da5-be93-c8b73ee02e14 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:30.781634 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fd5e4f86-e87c-4da5-be93-c8b73ee02e14 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:30.782723 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fd5e4f86-e87c-4da5-be93-c8b73ee02e14 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:30.783703 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fd5e4f86-e87c-4da5-be93-c8b73ee02e14 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:30.810607 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-fd5e4f86-e87c-4da5-be93-c8b73ee02e14 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lazy-loading 'flavor' on Instance uuid 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:10:31.098033 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fd5e4f86-e87c-4da5-be93-c8b73ee02e14 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "POST /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2/action" status: 202 len: 0 microversion: 2.20 time: 0.329130 Jun 06 21:10:31.098674 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 333/664] 10.222.0.33 () {62 vars in 1318 bytes} [Mon Jun 6 21:10:30 2022] POST /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 21:10:31.109287 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-3296f405-8bc4-487b-a5c9-10fe95fd6001 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:31.110159 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-3296f405-8bc4-487b-a5c9-10fe95fd6001 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:31.117488 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3296f405-8bc4-487b-a5c9-10fe95fd6001 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:31.117922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3296f405-8bc4-487b-a5c9-10fe95fd6001 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:31.118718 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3296f405-8bc4-487b-a5c9-10fe95fd6001 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:31.119138 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3296f405-8bc4-487b-a5c9-10fe95fd6001 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:31.263312 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-3296f405-8bc4-487b-a5c9-10fe95fd6001 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:31.272428 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-3296f405-8bc4-487b-a5c9-10fe95fd6001 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:31.273936 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-3296f405-8bc4-487b-a5c9-10fe95fd6001 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:31.275108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-3296f405-8bc4-487b-a5c9-10fe95fd6001 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1721 microversion: 2.20 time: 0.171164 Jun 06 21:10:31.275676 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 332/665] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:31 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:10:31.410799 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4d1541d5-debc-4347-ba10-7b8389246e34 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:31.411401 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4d1541d5-debc-4347-ba10-7b8389246e34 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:31.418559 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4d1541d5-debc-4347-ba10-7b8389246e34 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:31.419000 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4d1541d5-debc-4347-ba10-7b8389246e34 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:31.419758 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4d1541d5-debc-4347-ba10-7b8389246e34 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:31.420222 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4d1541d5-debc-4347-ba10-7b8389246e34 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:31.568290 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4d1541d5-debc-4347-ba10-7b8389246e34 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:31.576050 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4d1541d5-debc-4347-ba10-7b8389246e34 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab" status: 200 len: 1557 microversion: 2.1 time: 0.170727 Jun 06 21:10:31.576901 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 334/666] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:31 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab => generated 1557 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:31.594768 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-042b3461-e272-4839-b781-e800a9fe29e1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:31.595280 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-042b3461-e272-4839-b781-e800a9fe29e1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:31.601799 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-042b3461-e272-4839-b781-e800a9fe29e1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:31.602237 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-042b3461-e272-4839-b781-e800a9fe29e1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:31.603278 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-042b3461-e272-4839-b781-e800a9fe29e1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:31.603700 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-042b3461-e272-4839-b781-e800a9fe29e1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:31.718913 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-042b3461-e272-4839-b781-e800a9fe29e1 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127978 Jun 06 21:10:31.719656 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 333/667] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jun 6 21:10:31 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:10:32.303290 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bf4f736e-56fb-43f3-be08-cb069200ac6c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:32.304038 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bf4f736e-56fb-43f3-be08-cb069200ac6c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:32.310783 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf4f736e-56fb-43f3-be08-cb069200ac6c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:32.311233 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf4f736e-56fb-43f3-be08-cb069200ac6c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:32.312020 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf4f736e-56fb-43f3-be08-cb069200ac6c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:32.312612 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf4f736e-56fb-43f3-be08-cb069200ac6c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:32.473597 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bf4f736e-56fb-43f3-be08-cb069200ac6c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:32.491070 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bf4f736e-56fb-43f3-be08-cb069200ac6c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:32.494099 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bf4f736e-56fb-43f3-be08-cb069200ac6c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:32.496399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bf4f736e-56fb-43f3-be08-cb069200ac6c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1721 microversion: 2.20 time: 0.197402 Jun 06 21:10:32.497385 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 335/668] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:32 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:10:33.258511 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-4910f22f-7193-47b9-86eb-4859b21e057a req-e3e7921c-f77f-4978-bf17-c0e198ca88c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab", "tag": "15c41403-c077-4ee6-a769-5c89f46790c6"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:10:33.267072 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-4910f22f-7193-47b9-86eb-4859b21e057a req-e3e7921c-f77f-4978-bf17-c0e198ca88c1 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:33.267866 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-4910f22f-7193-47b9-86eb-4859b21e057a req-e3e7921c-f77f-4978-bf17-c0e198ca88c1 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:33.280418 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-4910f22f-7193-47b9-86eb-4859b21e057a req-e3e7921c-f77f-4978-bf17-c0e198ca88c1 service nova] Creating event network-changed:15c41403-c077-4ee6-a769-5c89f46790c6 for instance 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab on hv-cinder-84488 Jun 06 21:10:33.286009 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-4910f22f-7193-47b9-86eb-4859b21e057a req-e3e7921c-f77f-4978-bf17-c0e198ca88c1 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.281133 Jun 06 21:10:33.286639 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 334/669] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:10:33.515035 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b80d3d54-36e4-4731-bc97-f5bb6065cdc9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:33.516399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b80d3d54-36e4-4731-bc97-f5bb6065cdc9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:33.523373 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b80d3d54-36e4-4731-bc97-f5bb6065cdc9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:33.523815 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b80d3d54-36e4-4731-bc97-f5bb6065cdc9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:33.524651 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b80d3d54-36e4-4731-bc97-f5bb6065cdc9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:33.525085 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b80d3d54-36e4-4731-bc97-f5bb6065cdc9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:33.684374 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b80d3d54-36e4-4731-bc97-f5bb6065cdc9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:33.693762 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b80d3d54-36e4-4731-bc97-f5bb6065cdc9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:33.695850 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b80d3d54-36e4-4731-bc97-f5bb6065cdc9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:33.697597 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b80d3d54-36e4-4731-bc97-f5bb6065cdc9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1721 microversion: 2.20 time: 0.186312 Jun 06 21:10:33.711885 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 336/670] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:33 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1721 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:10:34.721058 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-91a22c75-b51e-4b8d-bb8b-614541cf98b0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:34.721830 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-91a22c75-b51e-4b8d-bb8b-614541cf98b0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:34.728694 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-91a22c75-b51e-4b8d-bb8b-614541cf98b0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:34.729135 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-91a22c75-b51e-4b8d-bb8b-614541cf98b0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:34.729890 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-91a22c75-b51e-4b8d-bb8b-614541cf98b0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:34.730314 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-91a22c75-b51e-4b8d-bb8b-614541cf98b0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:34.869424 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-91a22c75-b51e-4b8d-bb8b-614541cf98b0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:34.878092 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-91a22c75-b51e-4b8d-bb8b-614541cf98b0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:34.879644 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-91a22c75-b51e-4b8d-bb8b-614541cf98b0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:34.880832 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-91a22c75-b51e-4b8d-bb8b-614541cf98b0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1721 microversion: 2.20 time: 0.164658 Jun 06 21:10:34.881746 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 335/671] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:34 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:10:35.900411 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c50fb4d9-66e2-45f3-9dd9-1c7cd4203f2f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:35.901061 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c50fb4d9-66e2-45f3-9dd9-1c7cd4203f2f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:35.908326 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c50fb4d9-66e2-45f3-9dd9-1c7cd4203f2f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:35.908778 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c50fb4d9-66e2-45f3-9dd9-1c7cd4203f2f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:35.909539 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c50fb4d9-66e2-45f3-9dd9-1c7cd4203f2f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:35.909967 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c50fb4d9-66e2-45f3-9dd9-1c7cd4203f2f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:36.059928 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c50fb4d9-66e2-45f3-9dd9-1c7cd4203f2f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:36.081233 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c50fb4d9-66e2-45f3-9dd9-1c7cd4203f2f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:36.083737 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c50fb4d9-66e2-45f3-9dd9-1c7cd4203f2f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:36.085455 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c50fb4d9-66e2-45f3-9dd9-1c7cd4203f2f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1721 microversion: 2.20 time: 0.189115 Jun 06 21:10:36.086468 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 337/672] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:35 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:10:37.114123 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-73c93170-fc89-4236-b8b9-b1bef10b2774 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:37.114762 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-73c93170-fc89-4236-b8b9-b1bef10b2774 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:37.122257 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-73c93170-fc89-4236-b8b9-b1bef10b2774 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:37.122704 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-73c93170-fc89-4236-b8b9-b1bef10b2774 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:37.123567 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-73c93170-fc89-4236-b8b9-b1bef10b2774 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:37.123975 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-73c93170-fc89-4236-b8b9-b1bef10b2774 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:37.286241 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-73c93170-fc89-4236-b8b9-b1bef10b2774 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:37.295137 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-73c93170-fc89-4236-b8b9-b1bef10b2774 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:37.296809 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-73c93170-fc89-4236-b8b9-b1bef10b2774 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:37.297977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-73c93170-fc89-4236-b8b9-b1bef10b2774 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1721 microversion: 2.20 time: 0.188655 Jun 06 21:10:37.298825 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 336/673] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:37 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:10:38.318151 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a9938df8-065d-4e29-a005-7119aa0094df tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:38.318989 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a9938df8-065d-4e29-a005-7119aa0094df tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:38.326035 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a9938df8-065d-4e29-a005-7119aa0094df tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:38.326541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a9938df8-065d-4e29-a005-7119aa0094df tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:38.327790 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a9938df8-065d-4e29-a005-7119aa0094df tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:38.328252 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a9938df8-065d-4e29-a005-7119aa0094df tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:38.335773 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:10:38.496367 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a9938df8-065d-4e29-a005-7119aa0094df tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:38.505265 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a9938df8-065d-4e29-a005-7119aa0094df tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:38.506896 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a9938df8-065d-4e29-a005-7119aa0094df tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:38.508143 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a9938df8-065d-4e29-a005-7119aa0094df tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1721 microversion: 2.20 time: 0.194496 Jun 06 21:10:38.508797 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 338/674] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:38 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:10:39.527139 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-6a3be34d-b1ce-4025-9323-95e10872a5fa tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:39.527878 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-6a3be34d-b1ce-4025-9323-95e10872a5fa tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:39.535543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6a3be34d-b1ce-4025-9323-95e10872a5fa tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:39.536077 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6a3be34d-b1ce-4025-9323-95e10872a5fa tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:39.536881 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6a3be34d-b1ce-4025-9323-95e10872a5fa tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:39.537287 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6a3be34d-b1ce-4025-9323-95e10872a5fa tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:39.689856 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-6a3be34d-b1ce-4025-9323-95e10872a5fa tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:39.693804 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=100 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:10:39.699686 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-6a3be34d-b1ce-4025-9323-95e10872a5fa tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:39.701221 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-6a3be34d-b1ce-4025-9323-95e10872a5fa tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:39.702932 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-6a3be34d-b1ce-4025-9323-95e10872a5fa tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1721 microversion: 2.20 time: 0.179595 Jun 06 21:10:39.703639 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 337/675] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:39 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:10:40.722666 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d99d142d-12c3-4e98-ac5a-e95868833025 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:40.723655 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d99d142d-12c3-4e98-ac5a-e95868833025 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:40.730572 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d99d142d-12c3-4e98-ac5a-e95868833025 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:40.731017 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d99d142d-12c3-4e98-ac5a-e95868833025 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:40.731772 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d99d142d-12c3-4e98-ac5a-e95868833025 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:40.732232 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d99d142d-12c3-4e98-ac5a-e95868833025 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:40.876259 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d99d142d-12c3-4e98-ac5a-e95868833025 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:40.885975 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d99d142d-12c3-4e98-ac5a-e95868833025 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:40.887488 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d99d142d-12c3-4e98-ac5a-e95868833025 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:40.889210 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d99d142d-12c3-4e98-ac5a-e95868833025 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1721 microversion: 2.20 time: 0.170422 Jun 06 21:10:40.889862 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 339/676] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:40 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:10:41.908184 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2fd6d794-4df6-4c1f-b452-46cbd1d4155e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:41.908883 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-2fd6d794-4df6-4c1f-b452-46cbd1d4155e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:41.916424 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2fd6d794-4df6-4c1f-b452-46cbd1d4155e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:41.916865 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2fd6d794-4df6-4c1f-b452-46cbd1d4155e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:41.917619 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2fd6d794-4df6-4c1f-b452-46cbd1d4155e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:41.918037 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2fd6d794-4df6-4c1f-b452-46cbd1d4155e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:42.067791 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2fd6d794-4df6-4c1f-b452-46cbd1d4155e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:42.076194 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2fd6d794-4df6-4c1f-b452-46cbd1d4155e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:42.078037 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2fd6d794-4df6-4c1f-b452-46cbd1d4155e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:42.079195 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-2fd6d794-4df6-4c1f-b452-46cbd1d4155e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1721 microversion: 2.20 time: 0.175280 Jun 06 21:10:42.079762 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 338/677] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:41 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1721 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:10:43.098011 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-aa8beb0d-2a98-4fb0-a51d-ec7bd4312c32 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:43.098873 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-aa8beb0d-2a98-4fb0-a51d-ec7bd4312c32 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:43.101274 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:10:43.107341 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aa8beb0d-2a98-4fb0-a51d-ec7bd4312c32 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:43.107797 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aa8beb0d-2a98-4fb0-a51d-ec7bd4312c32 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:43.108578 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aa8beb0d-2a98-4fb0-a51d-ec7bd4312c32 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:43.109002 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aa8beb0d-2a98-4fb0-a51d-ec7bd4312c32 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:43.262132 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-aa8beb0d-2a98-4fb0-a51d-ec7bd4312c32 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:43.273543 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-aa8beb0d-2a98-4fb0-a51d-ec7bd4312c32 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:43.275089 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-aa8beb0d-2a98-4fb0-a51d-ec7bd4312c32 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:43.276316 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-aa8beb0d-2a98-4fb0-a51d-ec7bd4312c32 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1721 microversion: 2.20 time: 0.182182 Jun 06 21:10:43.276874 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 340/678] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:43 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:10:44.295368 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-9f851e78-2501-4d06-b40e-ddc93811183f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:44.296211 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-9f851e78-2501-4d06-b40e-ddc93811183f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:44.298666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:10:44.305403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9f851e78-2501-4d06-b40e-ddc93811183f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:44.305764 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9f851e78-2501-4d06-b40e-ddc93811183f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:44.306664 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9f851e78-2501-4d06-b40e-ddc93811183f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:44.307096 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9f851e78-2501-4d06-b40e-ddc93811183f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:44.703953 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-9f851e78-2501-4d06-b40e-ddc93811183f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:44.713106 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-9f851e78-2501-4d06-b40e-ddc93811183f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:44.714592 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-9f851e78-2501-4d06-b40e-ddc93811183f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:44.715759 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-9f851e78-2501-4d06-b40e-ddc93811183f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1721 microversion: 2.20 time: 0.424561 Jun 06 21:10:44.716555 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 339/679] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:44 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1721 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:10:45.734952 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5dc87870-489f-47ed-9245-49b005802cc3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:45.735599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5dc87870-489f-47ed-9245-49b005802cc3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:45.742810 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5dc87870-489f-47ed-9245-49b005802cc3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:45.743293 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5dc87870-489f-47ed-9245-49b005802cc3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:45.744051 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5dc87870-489f-47ed-9245-49b005802cc3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:45.744502 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5dc87870-489f-47ed-9245-49b005802cc3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:45.883666 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5dc87870-489f-47ed-9245-49b005802cc3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:45.891916 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5dc87870-489f-47ed-9245-49b005802cc3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:45.893525 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5dc87870-489f-47ed-9245-49b005802cc3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:45.894683 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5dc87870-489f-47ed-9245-49b005802cc3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1721 microversion: 2.20 time: 0.163766 Jun 06 21:10:45.895461 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 341/680] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:45 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:10:46.917338 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-3444d398-b299-44f8-a56e-b4497ba1a329 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:46.917966 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-3444d398-b299-44f8-a56e-b4497ba1a329 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:46.925277 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3444d398-b299-44f8-a56e-b4497ba1a329 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:46.925724 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3444d398-b299-44f8-a56e-b4497ba1a329 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:46.926800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3444d398-b299-44f8-a56e-b4497ba1a329 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:46.927247 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3444d398-b299-44f8-a56e-b4497ba1a329 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:47.086545 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-3444d398-b299-44f8-a56e-b4497ba1a329 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:47.095093 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-3444d398-b299-44f8-a56e-b4497ba1a329 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:47.096707 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-3444d398-b299-44f8-a56e-b4497ba1a329 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:47.097874 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-3444d398-b299-44f8-a56e-b4497ba1a329 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1721 microversion: 2.20 time: 0.184654 Jun 06 21:10:47.098484 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 340/681] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:46 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:10:48.118581 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-41e01e3e-59de-4b9e-a39a-1597c46c2725 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:48.119191 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-41e01e3e-59de-4b9e-a39a-1597c46c2725 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:48.127550 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-41e01e3e-59de-4b9e-a39a-1597c46c2725 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:48.128200 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-41e01e3e-59de-4b9e-a39a-1597c46c2725 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:48.129037 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-41e01e3e-59de-4b9e-a39a-1597c46c2725 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:48.129656 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-41e01e3e-59de-4b9e-a39a-1597c46c2725 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:48.545204 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-41e01e3e-59de-4b9e-a39a-1597c46c2725 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:48.554863 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-41e01e3e-59de-4b9e-a39a-1597c46c2725 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:48.556404 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-41e01e3e-59de-4b9e-a39a-1597c46c2725 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:48.557606 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-41e01e3e-59de-4b9e-a39a-1597c46c2725 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1721 microversion: 2.20 time: 0.443098 Jun 06 21:10:48.558199 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 342/682] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:48 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1721 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:10:49.584633 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-bc6c3397-42f4-423c-8265-53d45fe46766 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:49.585296 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-bc6c3397-42f4-423c-8265-53d45fe46766 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:49.592885 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bc6c3397-42f4-423c-8265-53d45fe46766 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:49.593357 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bc6c3397-42f4-423c-8265-53d45fe46766 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:49.594126 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bc6c3397-42f4-423c-8265-53d45fe46766 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:49.594616 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bc6c3397-42f4-423c-8265-53d45fe46766 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:49.766139 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-bc6c3397-42f4-423c-8265-53d45fe46766 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:49.775178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-bc6c3397-42f4-423c-8265-53d45fe46766 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:49.776705 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-bc6c3397-42f4-423c-8265-53d45fe46766 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:49.777884 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-bc6c3397-42f4-423c-8265-53d45fe46766 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1721 microversion: 2.20 time: 0.197738 Jun 06 21:10:49.778442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 341/683] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:49 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1721 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:10:50.796825 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-557454d2-7c26-46c1-a31f-1bea7d4cc410 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:50.797441 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-557454d2-7c26-46c1-a31f-1bea7d4cc410 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:50.804731 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-557454d2-7c26-46c1-a31f-1bea7d4cc410 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:50.805201 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-557454d2-7c26-46c1-a31f-1bea7d4cc410 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:50.805952 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-557454d2-7c26-46c1-a31f-1bea7d4cc410 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:50.806379 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-557454d2-7c26-46c1-a31f-1bea7d4cc410 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:50.954085 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-557454d2-7c26-46c1-a31f-1bea7d4cc410 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:50.963123 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-557454d2-7c26-46c1-a31f-1bea7d4cc410 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:50.964812 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-557454d2-7c26-46c1-a31f-1bea7d4cc410 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:50.966002 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-557454d2-7c26-46c1-a31f-1bea7d4cc410 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1721 microversion: 2.20 time: 0.173188 Jun 06 21:10:50.966576 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 343/684] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:50 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:10:51.984812 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-11bafad4-e09e-4b71-8895-287199c6f71a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:51.985426 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-11bafad4-e09e-4b71-8895-287199c6f71a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:51.993785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-11bafad4-e09e-4b71-8895-287199c6f71a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:51.994339 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-11bafad4-e09e-4b71-8895-287199c6f71a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:51.995196 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-11bafad4-e09e-4b71-8895-287199c6f71a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:51.995743 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-11bafad4-e09e-4b71-8895-287199c6f71a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:52.138799 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-11bafad4-e09e-4b71-8895-287199c6f71a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:52.156828 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-11bafad4-e09e-4b71-8895-287199c6f71a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:52.158315 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-11bafad4-e09e-4b71-8895-287199c6f71a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:52.159477 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-11bafad4-e09e-4b71-8895-287199c6f71a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1742 microversion: 2.20 time: 0.178703 Jun 06 21:10:52.160029 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 342/685] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:51 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1742 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:10:52.944468 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-015c3488-12f5-466f-8c51-8f8fcd075b7b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:10:52.945143 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-015c3488-12f5-466f-8c51-8f8fcd075b7b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:52.952695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-015c3488-12f5-466f-8c51-8f8fcd075b7b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:52.953143 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-015c3488-12f5-466f-8c51-8f8fcd075b7b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:52.953954 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-015c3488-12f5-466f-8c51-8f8fcd075b7b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:52.954383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-015c3488-12f5-466f-8c51-8f8fcd075b7b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:52.979670 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-015c3488-12f5-466f-8c51-8f8fcd075b7b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lazy-loading 'flavor' on Instance uuid 807baad3-4d23-4d63-b4a9-7163fc77e302 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:10:53.071112 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-015c3488-12f5-466f-8c51-8f8fcd075b7b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "POST /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302/action" status: 202 len: 0 microversion: 2.1 time: 0.132272 Jun 06 21:10:53.071732 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 344/686] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 6 21:10:52 2022] POST /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:10:53.081646 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-9fe245f2-f980-4e97-afde-8cf5153252a7 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:53.082399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-9fe245f2-f980-4e97-afde-8cf5153252a7 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:53.089889 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9fe245f2-f980-4e97-afde-8cf5153252a7 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:53.090315 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9fe245f2-f980-4e97-afde-8cf5153252a7 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:53.091149 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9fe245f2-f980-4e97-afde-8cf5153252a7 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:53.091633 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9fe245f2-f980-4e97-afde-8cf5153252a7 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:53.180709 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6d3acb7b-e7e7-4deb-8d59-4250e3d961f4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:53.181440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6d3acb7b-e7e7-4deb-8d59-4250e3d961f4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:53.188200 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d3acb7b-e7e7-4deb-8d59-4250e3d961f4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:53.188673 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d3acb7b-e7e7-4deb-8d59-4250e3d961f4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:53.189422 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d3acb7b-e7e7-4deb-8d59-4250e3d961f4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:53.189869 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6d3acb7b-e7e7-4deb-8d59-4250e3d961f4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:53.238997 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-9fe245f2-f980-4e97-afde-8cf5153252a7 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:53.247812 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-9fe245f2-f980-4e97-afde-8cf5153252a7 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1567 microversion: 2.1 time: 0.171162 Jun 06 21:10:53.248478 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 343/687] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:53 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:53.360860 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6d3acb7b-e7e7-4deb-8d59-4250e3d961f4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:53.375407 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6d3acb7b-e7e7-4deb-8d59-4250e3d961f4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:53.378355 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6d3acb7b-e7e7-4deb-8d59-4250e3d961f4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:53.380721 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6d3acb7b-e7e7-4deb-8d59-4250e3d961f4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1742 microversion: 2.20 time: 0.204872 Jun 06 21:10:53.381755 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 345/688] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:53 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1742 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:10:54.266204 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-f0814710-58c8-4640-a271-adb4cb66bc63 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:54.266836 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-f0814710-58c8-4640-a271-adb4cb66bc63 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:54.274501 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f0814710-58c8-4640-a271-adb4cb66bc63 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:54.274919 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f0814710-58c8-4640-a271-adb4cb66bc63 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:54.275735 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f0814710-58c8-4640-a271-adb4cb66bc63 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:54.276259 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f0814710-58c8-4640-a271-adb4cb66bc63 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:54.411709 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7275e632-c014-4e85-9757-fb938b62df94 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:54.413071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7275e632-c014-4e85-9757-fb938b62df94 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:54.421157 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7275e632-c014-4e85-9757-fb938b62df94 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:54.421603 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7275e632-c014-4e85-9757-fb938b62df94 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:54.422378 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7275e632-c014-4e85-9757-fb938b62df94 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:54.422914 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7275e632-c014-4e85-9757-fb938b62df94 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:54.440024 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-f0814710-58c8-4640-a271-adb4cb66bc63 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:54.449480 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-f0814710-58c8-4640-a271-adb4cb66bc63 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1567 microversion: 2.1 time: 0.187068 Jun 06 21:10:54.450086 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 344/689] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:54 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1567 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:54.580063 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7275e632-c014-4e85-9757-fb938b62df94 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:54.589852 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7275e632-c014-4e85-9757-fb938b62df94 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:54.591402 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7275e632-c014-4e85-9757-fb938b62df94 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:54.592669 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7275e632-c014-4e85-9757-fb938b62df94 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1742 microversion: 2.20 time: 0.185243 Jun 06 21:10:54.593282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 346/690] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:54 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1742 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:10:55.472865 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-66da913c-e5bc-4a74-b13c-5c84676c6721 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:55.474492 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-66da913c-e5bc-4a74-b13c-5c84676c6721 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:55.482033 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-66da913c-e5bc-4a74-b13c-5c84676c6721 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:55.482473 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-66da913c-e5bc-4a74-b13c-5c84676c6721 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:55.483245 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-66da913c-e5bc-4a74-b13c-5c84676c6721 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:55.483666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-66da913c-e5bc-4a74-b13c-5c84676c6721 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:55.611793 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ef0cfb38-c8af-4873-9020-9a4cf9ca209a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:55.613099 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ef0cfb38-c8af-4873-9020-9a4cf9ca209a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:55.621617 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ef0cfb38-c8af-4873-9020-9a4cf9ca209a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:55.622535 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ef0cfb38-c8af-4873-9020-9a4cf9ca209a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:55.623596 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ef0cfb38-c8af-4873-9020-9a4cf9ca209a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:55.624449 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ef0cfb38-c8af-4873-9020-9a4cf9ca209a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:55.693300 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-66da913c-e5bc-4a74-b13c-5c84676c6721 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:55.702578 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-66da913c-e5bc-4a74-b13c-5c84676c6721 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1567 microversion: 2.1 time: 0.234257 Jun 06 21:10:55.703240 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 345/691] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:55 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:55.800867 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ef0cfb38-c8af-4873-9020-9a4cf9ca209a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:55.813589 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ef0cfb38-c8af-4873-9020-9a4cf9ca209a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:55.816174 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ef0cfb38-c8af-4873-9020-9a4cf9ca209a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:55.817892 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ef0cfb38-c8af-4873-9020-9a4cf9ca209a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1737 microversion: 2.20 time: 0.209973 Jun 06 21:10:55.819055 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 347/692] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:55 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1737 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:10:56.369086 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-4e238ee6-9e1d-4b62-9a3d-689328d56826 req-a6800680-3dd4-4e2c-b6a0-bfb585c14a6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5670bfe4-7e75-44cc-93c9-59dbaad0a0b2", "name": "network-vif-plugged", "status": "completed", "tag": "04c1ea5e-e07f-49da-aad5-775bd6da5cac"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:10:56.381912 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-4e238ee6-9e1d-4b62-9a3d-689328d56826 req-a6800680-3dd4-4e2c-b6a0-bfb585c14a6a service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:56.382793 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-4e238ee6-9e1d-4b62-9a3d-689328d56826 req-a6800680-3dd4-4e2c-b6a0-bfb585c14a6a service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:56.398834 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-4e238ee6-9e1d-4b62-9a3d-689328d56826 req-a6800680-3dd4-4e2c-b6a0-bfb585c14a6a service nova] Creating event network-vif-plugged:04c1ea5e-e07f-49da-aad5-775bd6da5cac for instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 on hv-cinder-84488 Jun 06 21:10:56.407955 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-4e238ee6-9e1d-4b62-9a3d-689328d56826 req-a6800680-3dd4-4e2c-b6a0-bfb585c14a6a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042553 Jun 06 21:10:56.409365 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 346/693] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:10:56.722006 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f706000a-a582-49d3-82a8-6eba388553f2 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:56.722576 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f706000a-a582-49d3-82a8-6eba388553f2 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:56.730076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f706000a-a582-49d3-82a8-6eba388553f2 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:56.731514 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f706000a-a582-49d3-82a8-6eba388553f2 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:56.732685 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f706000a-a582-49d3-82a8-6eba388553f2 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:56.733293 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f706000a-a582-49d3-82a8-6eba388553f2 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:56.840192 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0fcfecf1-d6bb-432d-adb7-b4df9f1e7b53 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:56.841663 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-0fcfecf1-d6bb-432d-adb7-b4df9f1e7b53 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:56.849018 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0fcfecf1-d6bb-432d-adb7-b4df9f1e7b53 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:56.850006 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0fcfecf1-d6bb-432d-adb7-b4df9f1e7b53 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:56.851238 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0fcfecf1-d6bb-432d-adb7-b4df9f1e7b53 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:56.851893 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0fcfecf1-d6bb-432d-adb7-b4df9f1e7b53 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:56.970516 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f706000a-a582-49d3-82a8-6eba388553f2 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:56.984955 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f706000a-a582-49d3-82a8-6eba388553f2 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1567 microversion: 2.1 time: 0.266678 Jun 06 21:10:56.985995 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 348/694] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:56 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1567 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:57.027279 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-0fcfecf1-d6bb-432d-adb7-b4df9f1e7b53 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:57.044911 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-0fcfecf1-d6bb-432d-adb7-b4df9f1e7b53 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:57.047974 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-0fcfecf1-d6bb-432d-adb7-b4df9f1e7b53 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:57.050245 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-0fcfecf1-d6bb-432d-adb7-b4df9f1e7b53 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1737 microversion: 2.20 time: 0.215135 Jun 06 21:10:57.051707 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 347/695] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:56 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:10:58.014637 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d2bf8886-203b-4041-bd08-b801c61abf49 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:58.015247 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d2bf8886-203b-4041-bd08-b801c61abf49 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:58.025202 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d2bf8886-203b-4041-bd08-b801c61abf49 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:58.025703 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d2bf8886-203b-4041-bd08-b801c61abf49 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:58.026501 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d2bf8886-203b-4041-bd08-b801c61abf49 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:58.026940 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d2bf8886-203b-4041-bd08-b801c61abf49 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:58.071232 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-a683157b-b261-4f07-b9c5-b5a8604da75c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:58.072424 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-a683157b-b261-4f07-b9c5-b5a8604da75c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:58.084154 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a683157b-b261-4f07-b9c5-b5a8604da75c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:58.084978 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a683157b-b261-4f07-b9c5-b5a8604da75c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:58.085844 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a683157b-b261-4f07-b9c5-b5a8604da75c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:58.086354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a683157b-b261-4f07-b9c5-b5a8604da75c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:58.240044 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d2bf8886-203b-4041-bd08-b801c61abf49 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:58.249905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d2bf8886-203b-4041-bd08-b801c61abf49 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1567 microversion: 2.1 time: 0.239853 Jun 06 21:10:58.250604 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 349/696] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:58 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1567 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:58.278790 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-a683157b-b261-4f07-b9c5-b5a8604da75c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:58.288821 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-a683157b-b261-4f07-b9c5-b5a8604da75c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:58.290304 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-a683157b-b261-4f07-b9c5-b5a8604da75c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:58.291627 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-a683157b-b261-4f07-b9c5-b5a8604da75c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1737 microversion: 2.20 time: 0.225289 Jun 06 21:10:58.292476 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 348/697] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:58 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:10:59.267347 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4c45a283-55e3-468e-8e09-3bed04728a62 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:59.268202 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4c45a283-55e3-468e-8e09-3bed04728a62 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:59.274977 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4c45a283-55e3-468e-8e09-3bed04728a62 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:59.275919 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4c45a283-55e3-468e-8e09-3bed04728a62 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:59.276873 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4c45a283-55e3-468e-8e09-3bed04728a62 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:59.277390 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4c45a283-55e3-468e-8e09-3bed04728a62 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:59.313682 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-5bb2516f-d167-4e1b-ae44-3b18cd264f61 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:10:59.314270 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-5bb2516f-d167-4e1b-ae44-3b18cd264f61 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:10:59.322919 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5bb2516f-d167-4e1b-ae44-3b18cd264f61 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:59.323527 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5bb2516f-d167-4e1b-ae44-3b18cd264f61 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:59.324531 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5bb2516f-d167-4e1b-ae44-3b18cd264f61 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:10:59.325234 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5bb2516f-d167-4e1b-ae44-3b18cd264f61 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:10:59.476883 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4c45a283-55e3-468e-8e09-3bed04728a62 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:59.486970 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4c45a283-55e3-468e-8e09-3bed04728a62 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1567 microversion: 2.1 time: 0.223771 Jun 06 21:10:59.487700 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 350/698] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:10:59 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1567 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:10:59.554108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-5bb2516f-d167-4e1b-ae44-3b18cd264f61 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:59.584479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-5bb2516f-d167-4e1b-ae44-3b18cd264f61 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:59.589693 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-5bb2516f-d167-4e1b-ae44-3b18cd264f61 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:10:59.592454 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-5bb2516f-d167-4e1b-ae44-3b18cd264f61 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1737 microversion: 2.20 time: 0.283080 Jun 06 21:10:59.600527 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 349/699] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:10:59 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1737 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:11:00.506561 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b2173a92-b90c-4c1f-ae42-5ac37430655c tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:00.507680 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b2173a92-b90c-4c1f-ae42-5ac37430655c tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:00.522288 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2173a92-b90c-4c1f-ae42-5ac37430655c tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:00.523566 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2173a92-b90c-4c1f-ae42-5ac37430655c tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:00.525328 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2173a92-b90c-4c1f-ae42-5ac37430655c tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:00.527725 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b2173a92-b90c-4c1f-ae42-5ac37430655c tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:00.613024 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-23d25638-e0dc-4d9e-8d61-8bf93023b6e2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:00.614538 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-23d25638-e0dc-4d9e-8d61-8bf93023b6e2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:00.622409 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-23d25638-e0dc-4d9e-8d61-8bf93023b6e2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:00.623195 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-23d25638-e0dc-4d9e-8d61-8bf93023b6e2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:00.624033 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-23d25638-e0dc-4d9e-8d61-8bf93023b6e2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:00.624634 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-23d25638-e0dc-4d9e-8d61-8bf93023b6e2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:00.696256 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b2173a92-b90c-4c1f-ae42-5ac37430655c tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:00.705492 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b2173a92-b90c-4c1f-ae42-5ac37430655c tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1567 microversion: 2.1 time: 0.204206 Jun 06 21:11:00.720175 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 351/700] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:00 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:00.824983 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-23d25638-e0dc-4d9e-8d61-8bf93023b6e2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:00.838407 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-23d25638-e0dc-4d9e-8d61-8bf93023b6e2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:00.840368 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-23d25638-e0dc-4d9e-8d61-8bf93023b6e2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:00.842015 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-23d25638-e0dc-4d9e-8d61-8bf93023b6e2 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1737 microversion: 2.20 time: 0.233155 Jun 06 21:11:00.843174 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 350/701] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:00 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:11:01.727491 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-af9dd108-4f5c-42fc-9874-7e317ff04562 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:01.728997 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-af9dd108-4f5c-42fc-9874-7e317ff04562 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:01.740619 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-af9dd108-4f5c-42fc-9874-7e317ff04562 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:01.741925 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-af9dd108-4f5c-42fc-9874-7e317ff04562 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:01.743552 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-af9dd108-4f5c-42fc-9874-7e317ff04562 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:01.744664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-af9dd108-4f5c-42fc-9874-7e317ff04562 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:01.866094 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-027285b8-a62d-4d8b-8cd6-a9149b1a4599 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:01.868577 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-027285b8-a62d-4d8b-8cd6-a9149b1a4599 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:01.881294 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-027285b8-a62d-4d8b-8cd6-a9149b1a4599 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:01.882570 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-027285b8-a62d-4d8b-8cd6-a9149b1a4599 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:01.884283 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-027285b8-a62d-4d8b-8cd6-a9149b1a4599 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:01.885423 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-027285b8-a62d-4d8b-8cd6-a9149b1a4599 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:01.937832 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-af9dd108-4f5c-42fc-9874-7e317ff04562 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:01.942157 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:01.951251 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-af9dd108-4f5c-42fc-9874-7e317ff04562 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1567 microversion: 2.1 time: 0.230887 Jun 06 21:11:01.964808 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 352/702] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:01 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1567 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:02.101050 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-027285b8-a62d-4d8b-8cd6-a9149b1a4599 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:02.112124 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-027285b8-a62d-4d8b-8cd6-a9149b1a4599 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:02.113966 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-027285b8-a62d-4d8b-8cd6-a9149b1a4599 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:02.115290 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-027285b8-a62d-4d8b-8cd6-a9149b1a4599 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1737 microversion: 2.20 time: 0.256231 Jun 06 21:11:02.116036 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 351/703] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:01 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1737 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:11:02.898176 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-20a4f082-5cdb-47a8-ae2e-c4b70be4d3fb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:02.899606 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-20a4f082-5cdb-47a8-ae2e-c4b70be4d3fb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:02.908095 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20a4f082-5cdb-47a8-ae2e-c4b70be4d3fb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:02.908698 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20a4f082-5cdb-47a8-ae2e-c4b70be4d3fb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:02.909822 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20a4f082-5cdb-47a8-ae2e-c4b70be4d3fb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:02.911064 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-20a4f082-5cdb-47a8-ae2e-c4b70be4d3fb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:02.978633 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-4616221a-a32c-47d5-850f-594dab8da6c5 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:02.981456 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-4616221a-a32c-47d5-850f-594dab8da6c5 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:02.997535 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4616221a-a32c-47d5-850f-594dab8da6c5 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:02.998375 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4616221a-a32c-47d5-850f-594dab8da6c5 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:02.999957 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4616221a-a32c-47d5-850f-594dab8da6c5 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:03.001036 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4616221a-a32c-47d5-850f-594dab8da6c5 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:03.028221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-20a4f082-5cdb-47a8-ae2e-c4b70be4d3fb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lazy-loading 'services' on Instance uuid a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:11:03.181309 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-20a4f082-5cdb-47a8-ae2e-c4b70be4d3fb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1/os-volume_attachments/9b5dcf79-34f5-4bf0-a6a2-7e482687fdcb" status: 202 len: 0 microversion: 2.1 time: 0.287431 Jun 06 21:11:03.185549 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 353/704] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 6 21:11:02 2022] DELETE /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1/os-volume_attachments/9b5dcf79-34f5-4bf0-a6a2-7e482687fdcb => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 21:11:03.193984 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fe8bc552-9104-4227-95f1-0862662fbf81 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:03.195259 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fe8bc552-9104-4227-95f1-0862662fbf81 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:03.206829 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe8bc552-9104-4227-95f1-0862662fbf81 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:03.208349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe8bc552-9104-4227-95f1-0862662fbf81 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:03.209735 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe8bc552-9104-4227-95f1-0862662fbf81 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:03.210501 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe8bc552-9104-4227-95f1-0862662fbf81 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:03.252943 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-4616221a-a32c-47d5-850f-594dab8da6c5 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:03.264614 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-4616221a-a32c-47d5-850f-594dab8da6c5 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1567 microversion: 2.1 time: 0.292067 Jun 06 21:11:03.266109 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 352/705] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:02 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1567 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:11:03.279543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-61479eb6-9229-4c8b-81d0-aa3000aeb769 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:03.284622 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-61479eb6-9229-4c8b-81d0-aa3000aeb769 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:03.292234 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-61479eb6-9229-4c8b-81d0-aa3000aeb769 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:03.292702 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-61479eb6-9229-4c8b-81d0-aa3000aeb769 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:03.293987 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-61479eb6-9229-4c8b-81d0-aa3000aeb769 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:03.294434 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-61479eb6-9229-4c8b-81d0-aa3000aeb769 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:03.380584 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-61479eb6-9229-4c8b-81d0-aa3000aeb769 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109538 Jun 06 21:11:03.383336 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 353/706] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 6 21:11:03 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:11:03.598524 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fe8bc552-9104-4227-95f1-0862662fbf81 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:03.610261 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fe8bc552-9104-4227-95f1-0862662fbf81 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:03.612908 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fe8bc552-9104-4227-95f1-0862662fbf81 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:03.615418 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fe8bc552-9104-4227-95f1-0862662fbf81 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1737 microversion: 2.20 time: 0.430250 Jun 06 21:11:03.616369 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 354/707] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:03 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1737 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:11:04.299849 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-6d8f41dd-4634-4a4a-af19-ea9f8739b892 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:04.303880 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-6d8f41dd-4634-4a4a-af19-ea9f8739b892 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:04.324343 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6d8f41dd-4634-4a4a-af19-ea9f8739b892 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:04.325777 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6d8f41dd-4634-4a4a-af19-ea9f8739b892 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:04.329365 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6d8f41dd-4634-4a4a-af19-ea9f8739b892 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:04.330488 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6d8f41dd-4634-4a4a-af19-ea9f8739b892 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:04.398956 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-19242145-cd12-4210-a22e-a3a518d25971 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:04.405408 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-19242145-cd12-4210-a22e-a3a518d25971 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:04.421194 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-19242145-cd12-4210-a22e-a3a518d25971 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:04.421927 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-19242145-cd12-4210-a22e-a3a518d25971 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:04.422916 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-19242145-cd12-4210-a22e-a3a518d25971 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:04.423605 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-19242145-cd12-4210-a22e-a3a518d25971 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:04.465334 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-19242145-cd12-4210-a22e-a3a518d25971 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074283 Jun 06 21:11:04.470465 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 355/708] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 6 21:11:04 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:11:04.568659 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-6d8f41dd-4634-4a4a-af19-ea9f8739b892 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:04.577429 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-6d8f41dd-4634-4a4a-af19-ea9f8739b892 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1567 microversion: 2.1 time: 0.284847 Jun 06 21:11:04.578175 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 354/709] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:04 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1567 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:04.643285 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4126a5e5-18e8-4a55-9d41-4770c85eb4de tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:04.644053 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4126a5e5-18e8-4a55-9d41-4770c85eb4de tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:04.651657 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4126a5e5-18e8-4a55-9d41-4770c85eb4de tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:04.652172 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4126a5e5-18e8-4a55-9d41-4770c85eb4de tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:04.652894 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4126a5e5-18e8-4a55-9d41-4770c85eb4de tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:04.653447 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4126a5e5-18e8-4a55-9d41-4770c85eb4de tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:04.859249 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4126a5e5-18e8-4a55-9d41-4770c85eb4de tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:04.874179 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4126a5e5-18e8-4a55-9d41-4770c85eb4de tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:04.877020 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4126a5e5-18e8-4a55-9d41-4770c85eb4de tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:04.879315 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4126a5e5-18e8-4a55-9d41-4770c85eb4de tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1737 microversion: 2.20 time: 0.239780 Jun 06 21:11:04.880559 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 356/710] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:04 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:11:05.477958 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0a960cd4-6e2e-4249-8fdc-c6fd006047f1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:05.478901 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-0a960cd4-6e2e-4249-8fdc-c6fd006047f1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:05.486192 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0a960cd4-6e2e-4249-8fdc-c6fd006047f1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:05.486661 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0a960cd4-6e2e-4249-8fdc-c6fd006047f1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:05.487436 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0a960cd4-6e2e-4249-8fdc-c6fd006047f1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:05.487837 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0a960cd4-6e2e-4249-8fdc-c6fd006047f1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:05.492340 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=100 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:05.523716 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-0a960cd4-6e2e-4249-8fdc-c6fd006047f1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049732 Jun 06 21:11:05.524362 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 355/711] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 6 21:11:05 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 21:11:05.595676 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-98d210e4-2b09-4666-8ca9-b8c1c21ac407 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:05.596323 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-98d210e4-2b09-4666-8ca9-b8c1c21ac407 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:05.603397 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-98d210e4-2b09-4666-8ca9-b8c1c21ac407 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:05.603836 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-98d210e4-2b09-4666-8ca9-b8c1c21ac407 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:05.604638 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-98d210e4-2b09-4666-8ca9-b8c1c21ac407 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:05.605074 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-98d210e4-2b09-4666-8ca9-b8c1c21ac407 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:05.608415 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-54e0bd2d-aed0-4056-9cb8-fad639dade45 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:05.608935 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-54e0bd2d-aed0-4056-9cb8-fad639dade45 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:05.617555 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-54e0bd2d-aed0-4056-9cb8-fad639dade45 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:05.617989 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-54e0bd2d-aed0-4056-9cb8-fad639dade45 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:05.618755 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-54e0bd2d-aed0-4056-9cb8-fad639dade45 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:05.619179 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-54e0bd2d-aed0-4056-9cb8-fad639dade45 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:05.660983 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-54e0bd2d-aed0-4056-9cb8-fad639dade45 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Going to try to terminate instance {{(pid=117860) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 21:11:05.783952 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-98d210e4-2b09-4666-8ca9-b8c1c21ac407 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:05.784553 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-54e0bd2d-aed0-4056-9cb8-fad639dade45 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "DELETE /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 204 len: 0 microversion: 2.1 time: 0.180387 Jun 06 21:11:05.785369 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 356/712] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:11:05 2022] DELETE /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 06 21:11:05.795168 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e304700e-a763-4947-8941-927c54088395 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:05.796017 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-e304700e-a763-4947-8941-927c54088395 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:05.798759 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-98d210e4-2b09-4666-8ca9-b8c1c21ac407 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1567 microversion: 2.1 time: 0.206651 Jun 06 21:11:05.799822 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 357/713] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:05 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:05.802905 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e304700e-a763-4947-8941-927c54088395 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:05.803373 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e304700e-a763-4947-8941-927c54088395 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:05.804184 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e304700e-a763-4947-8941-927c54088395 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:05.804607 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e304700e-a763-4947-8941-927c54088395 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:05.909748 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-638309b5-c1d7-4604-a559-125d323904b9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:05.911083 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-638309b5-c1d7-4604-a559-125d323904b9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:05.919943 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-638309b5-c1d7-4604-a559-125d323904b9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:05.920524 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-638309b5-c1d7-4604-a559-125d323904b9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:05.921318 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-638309b5-c1d7-4604-a559-125d323904b9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:05.921755 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-638309b5-c1d7-4604-a559-125d323904b9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:05.959259 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e304700e-a763-4947-8941-927c54088395 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:05.967519 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-e304700e-a763-4947-8941-927c54088395 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1689 microversion: 2.1 time: 0.176803 Jun 06 21:11:05.968134 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 357/714] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:05 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:11:06.077919 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-638309b5-c1d7-4604-a559-125d323904b9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:06.086716 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-638309b5-c1d7-4604-a559-125d323904b9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:06.088292 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-638309b5-c1d7-4604-a559-125d323904b9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:06.089518 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-638309b5-c1d7-4604-a559-125d323904b9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1737 microversion: 2.20 time: 0.184504 Jun 06 21:11:06.090103 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 358/715] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:05 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:11:06.827136 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-71d83719-5db9-4c9a-859b-7d83f8a1ced9 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:06.827770 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-71d83719-5db9-4c9a-859b-7d83f8a1ced9 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:06.835528 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-71d83719-5db9-4c9a-859b-7d83f8a1ced9 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:06.836040 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-71d83719-5db9-4c9a-859b-7d83f8a1ced9 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:06.836872 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-71d83719-5db9-4c9a-859b-7d83f8a1ced9 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:06.837298 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-71d83719-5db9-4c9a-859b-7d83f8a1ced9 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:06.987543 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-33135a79-6aa2-41c9-8b94-f00f6c38512f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:06.988293 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-33135a79-6aa2-41c9-8b94-f00f6c38512f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:06.993312 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-71d83719-5db9-4c9a-859b-7d83f8a1ced9 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:06.995816 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-33135a79-6aa2-41c9-8b94-f00f6c38512f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:06.996413 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-33135a79-6aa2-41c9-8b94-f00f6c38512f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:06.997282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-33135a79-6aa2-41c9-8b94-f00f6c38512f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:06.997807 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-33135a79-6aa2-41c9-8b94-f00f6c38512f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:07.003252 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-71d83719-5db9-4c9a-859b-7d83f8a1ced9 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1567 microversion: 2.1 time: 0.180319 Jun 06 21:11:07.004032 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 358/716] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:06 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:07.108806 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2160dbec-ec2b-45f8-b7a4-e67b9c0616ac tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:07.109441 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-2160dbec-ec2b-45f8-b7a4-e67b9c0616ac tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:07.116266 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2160dbec-ec2b-45f8-b7a4-e67b9c0616ac tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:07.116679 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2160dbec-ec2b-45f8-b7a4-e67b9c0616ac tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:07.117449 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2160dbec-ec2b-45f8-b7a4-e67b9c0616ac tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:07.117874 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2160dbec-ec2b-45f8-b7a4-e67b9c0616ac tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:07.153145 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-33135a79-6aa2-41c9-8b94-f00f6c38512f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:07.162668 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-33135a79-6aa2-41c9-8b94-f00f6c38512f tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1689 microversion: 2.1 time: 0.179419 Jun 06 21:11:07.163391 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 359/717] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:06 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1689 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:07.256673 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2160dbec-ec2b-45f8-b7a4-e67b9c0616ac tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:07.270364 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2160dbec-ec2b-45f8-b7a4-e67b9c0616ac tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:07.272599 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2160dbec-ec2b-45f8-b7a4-e67b9c0616ac tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:07.274123 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-2160dbec-ec2b-45f8-b7a4-e67b9c0616ac tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1737 microversion: 2.20 time: 0.169295 Jun 06 21:11:07.274901 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 359/718] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:07 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:11:08.021416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-415d7e93-d304-4ce1-9184-ba3a6dea4556 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:08.021998 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-415d7e93-d304-4ce1-9184-ba3a6dea4556 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:08.028864 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-415d7e93-d304-4ce1-9184-ba3a6dea4556 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:08.029302 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-415d7e93-d304-4ce1-9184-ba3a6dea4556 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:08.030068 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-415d7e93-d304-4ce1-9184-ba3a6dea4556 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:08.030495 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-415d7e93-d304-4ce1-9184-ba3a6dea4556 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:08.186128 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-415d7e93-d304-4ce1-9184-ba3a6dea4556 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:08.186918 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-cd3ab9a5-1450-481e-90a7-34c2582c1676 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:08.187631 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-cd3ab9a5-1450-481e-90a7-34c2582c1676 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:08.194463 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-cd3ab9a5-1450-481e-90a7-34c2582c1676 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:08.194853 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-cd3ab9a5-1450-481e-90a7-34c2582c1676 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:08.195658 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-cd3ab9a5-1450-481e-90a7-34c2582c1676 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:08.196111 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-cd3ab9a5-1450-481e-90a7-34c2582c1676 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:08.196665 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-415d7e93-d304-4ce1-9184-ba3a6dea4556 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1567 microversion: 2.1 time: 0.179432 Jun 06 21:11:08.197287 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 360/719] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:08 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:08.297831 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0102d4a2-f0d4-4107-93f0-33c5bda863dd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:08.298951 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0102d4a2-f0d4-4107-93f0-33c5bda863dd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:08.308170 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0102d4a2-f0d4-4107-93f0-33c5bda863dd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:08.308748 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0102d4a2-f0d4-4107-93f0-33c5bda863dd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:08.309793 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0102d4a2-f0d4-4107-93f0-33c5bda863dd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:08.310318 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0102d4a2-f0d4-4107-93f0-33c5bda863dd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:08.362607 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-cd3ab9a5-1450-481e-90a7-34c2582c1676 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:08.376905 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-cd3ab9a5-1450-481e-90a7-34c2582c1676 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1689 microversion: 2.1 time: 0.193591 Jun 06 21:11:08.377857 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 360/720] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:08 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1689 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:08.480070 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0102d4a2-f0d4-4107-93f0-33c5bda863dd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:08.489210 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0102d4a2-f0d4-4107-93f0-33c5bda863dd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:08.490719 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0102d4a2-f0d4-4107-93f0-33c5bda863dd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:08.491949 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0102d4a2-f0d4-4107-93f0-33c5bda863dd tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1737 microversion: 2.20 time: 0.201650 Jun 06 21:11:08.492553 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 361/721] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:08 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:11:09.221380 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-f1bd67d3-1131-4532-bd78-10ddfaa134a6 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:09.222002 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-f1bd67d3-1131-4532-bd78-10ddfaa134a6 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:09.229904 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f1bd67d3-1131-4532-bd78-10ddfaa134a6 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:09.230347 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f1bd67d3-1131-4532-bd78-10ddfaa134a6 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:09.231115 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f1bd67d3-1131-4532-bd78-10ddfaa134a6 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:09.231539 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f1bd67d3-1131-4532-bd78-10ddfaa134a6 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:09.382831 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-f1bd67d3-1131-4532-bd78-10ddfaa134a6 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:09.397443 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-f1bd67d3-1131-4532-bd78-10ddfaa134a6 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1567 microversion: 2.1 time: 0.180051 Jun 06 21:11:09.398539 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 361/722] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:09 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1567 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:09.403126 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d90f2e99-7edb-4e1b-b2fe-9d4b9c6580b6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:09.404179 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d90f2e99-7edb-4e1b-b2fe-9d4b9c6580b6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:09.412487 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d90f2e99-7edb-4e1b-b2fe-9d4b9c6580b6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:09.412928 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d90f2e99-7edb-4e1b-b2fe-9d4b9c6580b6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:09.413732 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d90f2e99-7edb-4e1b-b2fe-9d4b9c6580b6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:09.414159 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d90f2e99-7edb-4e1b-b2fe-9d4b9c6580b6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:09.522285 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-72ea8b12-a066-433a-a9ba-d8687028c4d6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:09.523270 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-72ea8b12-a066-433a-a9ba-d8687028c4d6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:09.530699 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-72ea8b12-a066-433a-a9ba-d8687028c4d6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:09.531565 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-72ea8b12-a066-433a-a9ba-d8687028c4d6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:09.532419 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-72ea8b12-a066-433a-a9ba-d8687028c4d6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:09.532849 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-72ea8b12-a066-433a-a9ba-d8687028c4d6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:09.609859 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d90f2e99-7edb-4e1b-b2fe-9d4b9c6580b6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:09.619750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d90f2e99-7edb-4e1b-b2fe-9d4b9c6580b6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1689 microversion: 2.1 time: 0.220698 Jun 06 21:11:09.620418 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 362/723] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:09 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1689 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:09.697192 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-72ea8b12-a066-433a-a9ba-d8687028c4d6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:09.706457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-72ea8b12-a066-433a-a9ba-d8687028c4d6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:09.708538 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-72ea8b12-a066-433a-a9ba-d8687028c4d6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:09.709774 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-72ea8b12-a066-433a-a9ba-d8687028c4d6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1737 microversion: 2.20 time: 0.193933 Jun 06 21:11:09.710359 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 362/724] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:09 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1737 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:11:10.245982 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-916ddb1f-0311-457c-93f1-ad7b1d1c5a7f req-4e5ebf10-fb9e-44a1-93ea-e41aa1e507b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807baad3-4d23-4d63-b4a9-7163fc77e302", "name": "network-vif-unplugged", "status": "completed", "tag": "98717e19-2897-4922-9eb5-8ca664fad7a8"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:11:10.264953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-916ddb1f-0311-457c-93f1-ad7b1d1c5a7f req-4e5ebf10-fb9e-44a1-93ea-e41aa1e507b6 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:10.265894 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-916ddb1f-0311-457c-93f1-ad7b1d1c5a7f req-4e5ebf10-fb9e-44a1-93ea-e41aa1e507b6 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:10.296231 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-916ddb1f-0311-457c-93f1-ad7b1d1c5a7f req-4e5ebf10-fb9e-44a1-93ea-e41aa1e507b6 service nova] Creating event network-vif-unplugged:98717e19-2897-4922-9eb5-8ca664fad7a8 for instance 807baad3-4d23-4d63-b4a9-7163fc77e302 on hv-cinder-84488 Jun 06 21:11:10.307887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-916ddb1f-0311-457c-93f1-ad7b1d1c5a7f req-4e5ebf10-fb9e-44a1-93ea-e41aa1e507b6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070288 Jun 06 21:11:10.310592 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 363/725] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:11:10.423448 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-7f411c13-e496-4a97-9097-e92236c4e33a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:10.425400 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-7f411c13-e496-4a97-9097-e92236c4e33a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:10.438586 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7f411c13-e496-4a97-9097-e92236c4e33a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:10.439297 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7f411c13-e496-4a97-9097-e92236c4e33a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:10.457509 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7f411c13-e496-4a97-9097-e92236c4e33a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:10.458306 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7f411c13-e496-4a97-9097-e92236c4e33a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:10.641978 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-264a517b-e8ef-4ef5-b558-2728052dd2ba tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:10.642974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-264a517b-e8ef-4ef5-b558-2728052dd2ba tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:10.653693 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-264a517b-e8ef-4ef5-b558-2728052dd2ba tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:10.654394 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-264a517b-e8ef-4ef5-b558-2728052dd2ba tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:10.655279 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-264a517b-e8ef-4ef5-b558-2728052dd2ba tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:10.655815 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-264a517b-e8ef-4ef5-b558-2728052dd2ba tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:10.825923 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-7f411c13-e496-4a97-9097-e92236c4e33a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:10.840286 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-7f411c13-e496-4a97-9097-e92236c4e33a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1567 microversion: 2.1 time: 0.426372 Jun 06 21:11:10.841579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 363/726] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:10 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1567 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:10.850915 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e60f7f4f-5900-4fbe-92e4-e654d40b95e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:10.852343 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-e60f7f4f-5900-4fbe-92e4-e654d40b95e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:10.865176 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e60f7f4f-5900-4fbe-92e4-e654d40b95e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:10.865889 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e60f7f4f-5900-4fbe-92e4-e654d40b95e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:10.867178 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e60f7f4f-5900-4fbe-92e4-e654d40b95e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:10.867873 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e60f7f4f-5900-4fbe-92e4-e654d40b95e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:10.868083 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-264a517b-e8ef-4ef5-b558-2728052dd2ba tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:10.880507 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-264a517b-e8ef-4ef5-b558-2728052dd2ba tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1689 microversion: 2.1 time: 0.244982 Jun 06 21:11:10.882036 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 364/727] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:10 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1689 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:11.224059 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e60f7f4f-5900-4fbe-92e4-e654d40b95e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:11.233858 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e60f7f4f-5900-4fbe-92e4-e654d40b95e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:11.235695 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e60f7f4f-5900-4fbe-92e4-e654d40b95e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:11.236680 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-e60f7f4f-5900-4fbe-92e4-e654d40b95e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1719 microversion: 2.20 time: 0.393683 Jun 06 21:11:11.237311 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 364/728] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:10 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1719 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:11:11.684632 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-709937e8-449c-48ef-828a-b1d383f97721 req-43315993-e9b3-478e-8d75-939cfaa55908 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1", "name": "network-vif-deleted", "tag": "bde81077-0263-4b2a-91eb-97a7fd73212f"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:11:11.694401 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-709937e8-449c-48ef-828a-b1d383f97721 req-43315993-e9b3-478e-8d75-939cfaa55908 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:11.694854 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-709937e8-449c-48ef-828a-b1d383f97721 req-43315993-e9b3-478e-8d75-939cfaa55908 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:11.708749 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-709937e8-449c-48ef-828a-b1d383f97721 req-43315993-e9b3-478e-8d75-939cfaa55908 service nova] Creating event network-vif-deleted:bde81077-0263-4b2a-91eb-97a7fd73212f for instance a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 on hv-cinder-84488 Jun 06 21:11:11.715259 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-709937e8-449c-48ef-828a-b1d383f97721 req-43315993-e9b3-478e-8d75-939cfaa55908 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035876 Jun 06 21:11:11.716283 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 365/729] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:11:11.870848 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-a3321885-ad7c-487b-938e-7b6702106173 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:11.872073 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-a3321885-ad7c-487b-938e-7b6702106173 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:11.883965 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a3321885-ad7c-487b-938e-7b6702106173 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:11.884824 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a3321885-ad7c-487b-938e-7b6702106173 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:11.886237 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a3321885-ad7c-487b-938e-7b6702106173 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:11.887009 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a3321885-ad7c-487b-938e-7b6702106173 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:11.907680 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d548ef0f-404d-4a78-ad82-d2f16d013317 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:11.908312 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d548ef0f-404d-4a78-ad82-d2f16d013317 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:11.917142 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d548ef0f-404d-4a78-ad82-d2f16d013317 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:11.917440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d548ef0f-404d-4a78-ad82-d2f16d013317 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:11.918015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d548ef0f-404d-4a78-ad82-d2f16d013317 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:11.918657 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d548ef0f-404d-4a78-ad82-d2f16d013317 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:12.003985 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d548ef0f-404d-4a78-ad82-d2f16d013317 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:12.024053 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d548ef0f-404d-4a78-ad82-d2f16d013317 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1621 microversion: 2.1 time: 0.116601 Jun 06 21:11:12.025035 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 366/730] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:11 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1621 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:11:12.098505 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-a3321885-ad7c-487b-938e-7b6702106173 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:12.107039 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-a3321885-ad7c-487b-938e-7b6702106173 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1508 microversion: 2.1 time: 0.244040 Jun 06 21:11:12.107648 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 365/731] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:11 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1508 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:12.124573 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-86c5acaf-cb2d-4992-aebc-bd7c4d8b0cfc tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:11:12.125136 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-86c5acaf-cb2d-4992-aebc-bd7c4d8b0cfc tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:12.131842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86c5acaf-cb2d-4992-aebc-bd7c4d8b0cfc tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:12.132328 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86c5acaf-cb2d-4992-aebc-bd7c4d8b0cfc tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:12.133112 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86c5acaf-cb2d-4992-aebc-bd7c4d8b0cfc tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:12.133550 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-86c5acaf-cb2d-4992-aebc-bd7c4d8b0cfc tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:12.223402 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-86c5acaf-cb2d-4992-aebc-bd7c4d8b0cfc tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "POST /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302/action" status: 202 len: 0 microversion: 2.1 time: 0.102907 Jun 06 21:11:12.225694 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 367/732] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 6 21:11:12 2022] POST /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:11:12.238421 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-f94667a8-9b69-4f50-8787-c300b27074e1 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:12.239336 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-f94667a8-9b69-4f50-8787-c300b27074e1 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:12.251335 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f94667a8-9b69-4f50-8787-c300b27074e1 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:12.252587 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f94667a8-9b69-4f50-8787-c300b27074e1 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:12.254278 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f94667a8-9b69-4f50-8787-c300b27074e1 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:12.255447 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f94667a8-9b69-4f50-8787-c300b27074e1 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:12.260890 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5568b3d8-4c00-415e-831f-7f1d357a4b8a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:12.261450 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5568b3d8-4c00-415e-831f-7f1d357a4b8a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:12.269554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5568b3d8-4c00-415e-831f-7f1d357a4b8a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:12.270083 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5568b3d8-4c00-415e-831f-7f1d357a4b8a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:12.270995 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5568b3d8-4c00-415e-831f-7f1d357a4b8a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:12.271435 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5568b3d8-4c00-415e-831f-7f1d357a4b8a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:12.508945 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-f94667a8-9b69-4f50-8787-c300b27074e1 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:12.523185 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-f94667a8-9b69-4f50-8787-c300b27074e1 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1516 microversion: 2.1 time: 0.292847 Jun 06 21:11:12.529426 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 366/733] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:12 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1516 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:12.560404 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5568b3d8-4c00-415e-831f-7f1d357a4b8a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:12.574300 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5568b3d8-4c00-415e-831f-7f1d357a4b8a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:12.577567 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5568b3d8-4c00-415e-831f-7f1d357a4b8a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:12.579618 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5568b3d8-4c00-415e-831f-7f1d357a4b8a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1719 microversion: 2.20 time: 0.326275 Jun 06 21:11:12.580637 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 368/734] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:12 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1719 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:11:13.044631 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-4eb506b4-1a3b-45c3-bef9-83fb4fcd5dd6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:13.046039 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-4eb506b4-1a3b-45c3-bef9-83fb4fcd5dd6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:13.056745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4eb506b4-1a3b-45c3-bef9-83fb4fcd5dd6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:13.057292 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4eb506b4-1a3b-45c3-bef9-83fb4fcd5dd6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:13.058555 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4eb506b4-1a3b-45c3-bef9-83fb4fcd5dd6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:13.059316 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4eb506b4-1a3b-45c3-bef9-83fb4fcd5dd6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:13.177195 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-4eb506b4-1a3b-45c3-bef9-83fb4fcd5dd6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:13.189648 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-4eb506b4-1a3b-45c3-bef9-83fb4fcd5dd6 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 200 len: 1621 microversion: 2.1 time: 0.151277 Jun 06 21:11:13.192832 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 367/735] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:13 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 1621 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:13.554148 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-51d23342-0ab0-451d-a3d6-71745cf55451 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:13.555223 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-51d23342-0ab0-451d-a3d6-71745cf55451 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:13.572556 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=60 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:13.582821 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-51d23342-0ab0-451d-a3d6-71745cf55451 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:13.583538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-51d23342-0ab0-451d-a3d6-71745cf55451 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:13.584840 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-51d23342-0ab0-451d-a3d6-71745cf55451 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:13.585545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-51d23342-0ab0-451d-a3d6-71745cf55451 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:13.603958 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-19eb4de0-afab-4176-b932-757909750df9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:13.604814 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-19eb4de0-afab-4176-b932-757909750df9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:13.605414 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:13.623740 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-19eb4de0-afab-4176-b932-757909750df9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:13.624275 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-19eb4de0-afab-4176-b932-757909750df9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:13.630370 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-19eb4de0-afab-4176-b932-757909750df9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:13.631389 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-19eb4de0-afab-4176-b932-757909750df9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:13.818864 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-51d23342-0ab0-451d-a3d6-71745cf55451 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:13.829233 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-51d23342-0ab0-451d-a3d6-71745cf55451 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1518 microversion: 2.1 time: 0.282427 Jun 06 21:11:13.829995 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 369/736] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:13 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1518 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:13.834086 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-19eb4de0-afab-4176-b932-757909750df9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:13.843295 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-19eb4de0-afab-4176-b932-757909750df9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:13.844974 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-19eb4de0-afab-4176-b932-757909750df9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:13.846260 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-19eb4de0-afab-4176-b932-757909750df9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1722 microversion: 2.20 time: 0.249148 Jun 06 21:11:13.846781 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 368/737] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:13 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:11:13.866145 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ac37b62a-c3ad-4fba-954e-fa3f487fb60d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a7481ae-4944-4375-9745-e9460408ed1d"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:11:13.867305 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ac37b62a-c3ad-4fba-954e-fa3f487fb60d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:13.874353 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac37b62a-c3ad-4fba-954e-fa3f487fb60d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:13.874848 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac37b62a-c3ad-4fba-954e-fa3f487fb60d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:13.875548 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac37b62a-c3ad-4fba-954e-fa3f487fb60d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:13.875984 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac37b62a-c3ad-4fba-954e-fa3f487fb60d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:14.221262 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-3e23c062-f11e-4696-beb9-7d47b92c5eb4 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:14.222875 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-3e23c062-f11e-4696-beb9-7d47b92c5eb4 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:14.236023 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3e23c062-f11e-4696-beb9-7d47b92c5eb4 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:14.237686 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3e23c062-f11e-4696-beb9-7d47b92c5eb4 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:14.239968 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3e23c062-f11e-4696-beb9-7d47b92c5eb4 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:14.241081 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3e23c062-f11e-4696-beb9-7d47b92c5eb4 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:14.277363 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-3e23c062-f11e-4696-beb9-7d47b92c5eb4 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] HTTP exception thrown: Instance a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 could not be found. Jun 06 21:11:14.283189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-3e23c062-f11e-4696-beb9-7d47b92c5eb4 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Request method failure captured: Jun 06 21:11:14.283189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 HTTP/1.1 Jun 06 21:11:14.283189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:11:14.283189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:11:14.283189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:11:14.283189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 0 Jun 06 21:11:14.283189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:11:14.283189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:11:14.283189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:11:14.283189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:11:14.283189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinmw5kgLR6NMd10ofnxehsGJrZH5eihmOg4VV2rlqBjZwvfhUx8kow_T1NaOr6zNm6K1jJsuYEhS0J5QDngP2LhFXAmzwJ6InRv6t8Nhyq76ejvBrCHdAnd0U1eHtmfrOhv9AMEP1mJ0K9M-NNm9AUbkBVRKPRAi4NyD11SlCUna2Q5g Jun 06 21:11:14.283189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:11:14.283189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:11:14.283189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:11:14.283189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:11:14.283189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:11:14.283189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:11:14.283189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: f0246519bc2240cf8d1ba54172c0faca Jun 06 21:11:14.283189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-615855304 Jun 06 21:11:14.283189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:11:14.283189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:11:14.286549 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0246519bc2240cf8d1ba54172c0faca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f0246519bc2240cf8d1ba54172c0faca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f0246519bc2240cf8d1ba54172c0faca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0246519bc2240cf8d1ba54172c0faca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:11:14.286549 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-ServerRescueNegativeTestJSON-615855304 Jun 06 21:11:14.286549 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: f0246519bc2240cf8d1ba54172c0faca Jun 06 21:11:14.286549 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-615855304 Jun 06 21:11:14.286549 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-ServerRescueNegativeTestJSON-615855304-project Jun 06 21:11:14.286549 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:11:14.286549 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:11:14.286549 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: ab9da673f40b4e3eb541fdc380cfe282 Jun 06 21:11:14.286549 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-ServerRescueNegativeTestJSON-615855304-project Jun 06 21:11:14.286549 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: > Jun 06 21:11:14.286549 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Instance a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 could not be found. Jun 06 21:11:14.286549 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'id': 'a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1'} Jun 06 21:11:14.288579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:11:14.288579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:14.288579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:11:14.288579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:11:14.288579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:11:14.288579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:11:14.288579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:11:14.288579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:11:14.288579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:11:14.288579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:11:14.288579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 could not be found. Jun 06 21:11:14.288579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:14.288579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:14.288579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:14.288579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:14.288579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:14.288579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:14.288579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:11:14.288579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:11:14.288579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:11:14.291626 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:11:14.291626 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:11:14.291626 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:11:14.291626 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:11:14.291626 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:11:14.291626 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:11:14.291626 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:11:14.291626 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 could not be found. Jun 06 21:11:14.291626 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:14.291626 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:14.291626 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:14.291626 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:14.291626 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:14.291626 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:14.291626 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:11:14.291626 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:11:14.291626 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 could not be found. Jun 06 21:11:14.291626 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:14.297622 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-3e23c062-f11e-4696-beb9-7d47b92c5eb4 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Returning 404 to user: Instance a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 could not be found. {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:11:14.297622 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-3e23c062-f11e-4696-beb9-7d47b92c5eb4 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1" status: 404 len: 111 microversion: 2.1 time: 0.085820 Jun 06 21:11:14.298761 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 369/738] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:14 2022] GET /compute/v2.1/servers/a20dfe3d-e215-4d78-83ca-ce0f1bc02ba1 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:11:14.309381 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-5a08bd3d-5f8f-43d8-8abe-0aa22cc40727 req-1003e5e6-cd0b-491c-b434-45765cca92c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5670bfe4-7e75-44cc-93c9-59dbaad0a0b2", "name": "network-vif-unplugged", "status": "completed", "tag": "04c1ea5e-e07f-49da-aad5-775bd6da5cac"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:11:14.323580 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ac37b62a-c3ad-4fba-954e-fa3f487fb60d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "POST /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.462195 Jun 06 21:11:14.324577 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 370/739] 10.222.0.33 () {62 vars in 1363 bytes} [Mon Jun 6 21:11:13 2022] POST /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2/os-volume_attachments => generated 188 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 21:11:14.328839 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:14.333092 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b7c46a9e-a0d4-49c0-8250-64c879b6c111 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '.version_select at 0x7f27257f0ca0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:14.337154 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-5a08bd3d-5f8f-43d8-8abe-0aa22cc40727 req-1003e5e6-cd0b-491c-b434-45765cca92c7 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:14.338076 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-5a08bd3d-5f8f-43d8-8abe-0aa22cc40727 req-1003e5e6-cd0b-491c-b434-45765cca92c7 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:14.362813 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.compute.server_external_events [req-5a08bd3d-5f8f-43d8-8abe-0aa22cc40727 req-1003e5e6-cd0b-491c-b434-45765cca92c7 service nova] Unable to find a host for instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2. Dropping event network-vif-unplugged {{(pid=117860) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 06 21:11:14.364993 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-5a08bd3d-5f8f-43d8-8abe-0aa22cc40727 req-1003e5e6-cd0b-491c-b434-45765cca92c7 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.063218 Jun 06 21:11:14.366537 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 370/740] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 67 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 06 21:11:14.375543 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b7c46a9e-a0d4-49c0-8250-64c879b6c111 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-998164194" status: 202 len: 0 microversion: 2.1 time: 0.049671 Jun 06 21:11:14.376880 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 371/741] 10.222.0.33 () {58 vars in 1217 bytes} [Mon Jun 6 21:11:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-998164194 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:11:14.543265 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-3d1490dd-07a5-46ac-83bc-9f9f9019206c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:14.543761 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-3d1490dd-07a5-46ac-83bc-9f9f9019206c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:14.550000 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3d1490dd-07a5-46ac-83bc-9f9f9019206c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:14.550487 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3d1490dd-07a5-46ac-83bc-9f9f9019206c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:14.551288 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3d1490dd-07a5-46ac-83bc-9f9f9019206c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:14.551763 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3d1490dd-07a5-46ac-83bc-9f9f9019206c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:14.579847 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:14.852724 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e07e322e-a1e2-41eb-a80e-f84b0567c629 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:14.854369 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e07e322e-a1e2-41eb-a80e-f84b0567c629 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:14.863517 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e07e322e-a1e2-41eb-a80e-f84b0567c629 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:14.864538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e07e322e-a1e2-41eb-a80e-f84b0567c629 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:14.865920 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e07e322e-a1e2-41eb-a80e-f84b0567c629 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:14.866665 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e07e322e-a1e2-41eb-a80e-f84b0567c629 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:14.874347 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-3d1490dd-07a5-46ac-83bc-9f9f9019206c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2/os-volume_attachments/0a7481ae-4944-4375-9745-e9460408ed1d" status: 202 len: 0 microversion: 2.20 time: 0.334923 Jun 06 21:11:14.875756 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 371/742] 10.222.0.33 () {60 vars in 1456 bytes} [Mon Jun 6 21:11:14 2022] DELETE /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2/os-volume_attachments/0a7481ae-4944-4375-9745-e9460408ed1d => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 21:11:14.955583 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-3cb3261d-73f0-486b-9c0a-42afe9848641 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:11:14.956644 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-3cb3261d-73f0-486b-9c0a-42afe9848641 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:14.975575 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3cb3261d-73f0-486b-9c0a-42afe9848641 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:14.976422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3cb3261d-73f0-486b-9c0a-42afe9848641 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:14.977510 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3cb3261d-73f0-486b-9c0a-42afe9848641 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:14.978232 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3cb3261d-73f0-486b-9c0a-42afe9848641 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:15.080891 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e07e322e-a1e2-41eb-a80e-f84b0567c629 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:15.094287 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e07e322e-a1e2-41eb-a80e-f84b0567c629 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1574 microversion: 2.1 time: 0.248459 Jun 06 21:11:15.095125 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 372/743] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:14 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1574 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:11:15.255221 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-3cb3261d-73f0-486b-9c0a-42afe9848641 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "POST /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2/action" status: 202 len: 0 microversion: 2.20 time: 0.307447 Jun 06 21:11:15.261571 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 372/744] 10.222.0.33 () {62 vars in 1318 bytes} [Mon Jun 6 21:11:14 2022] POST /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 06 21:11:15.267333 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ac434e7d-a068-4ebb-805c-e50254bd8662 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:15.268480 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ac434e7d-a068-4ebb-805c-e50254bd8662 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:15.277857 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac434e7d-a068-4ebb-805c-e50254bd8662 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:15.278360 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac434e7d-a068-4ebb-805c-e50254bd8662 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:15.279207 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac434e7d-a068-4ebb-805c-e50254bd8662 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:15.279650 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac434e7d-a068-4ebb-805c-e50254bd8662 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:15.505858 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ac434e7d-a068-4ebb-805c-e50254bd8662 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:15.522098 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ac434e7d-a068-4ebb-805c-e50254bd8662 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:15.525415 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ac434e7d-a068-4ebb-805c-e50254bd8662 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:15.528632 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ac434e7d-a068-4ebb-805c-e50254bd8662 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1670 microversion: 2.20 time: 0.264601 Jun 06 21:11:15.530529 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 373/745] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:15 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1670 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:11:16.127776 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-3172ab94-1c74-4794-b49b-20b09e5e1a92 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:16.130449 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-3172ab94-1c74-4794-b49b-20b09e5e1a92 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:16.144624 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3172ab94-1c74-4794-b49b-20b09e5e1a92 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:16.145652 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3172ab94-1c74-4794-b49b-20b09e5e1a92 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:16.147760 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3172ab94-1c74-4794-b49b-20b09e5e1a92 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:16.149447 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3172ab94-1c74-4794-b49b-20b09e5e1a92 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:16.442408 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-3172ab94-1c74-4794-b49b-20b09e5e1a92 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:16.452159 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-3172ab94-1c74-4794-b49b-20b09e5e1a92 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1574 microversion: 2.1 time: 0.333948 Jun 06 21:11:16.452940 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 373/746] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:16 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1574 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:16.553794 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-32ba1d7f-45f0-4268-878b-1753e16da32e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:16.554854 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-32ba1d7f-45f0-4268-878b-1753e16da32e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:16.565079 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-32ba1d7f-45f0-4268-878b-1753e16da32e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:16.565518 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-32ba1d7f-45f0-4268-878b-1753e16da32e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:16.566559 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-32ba1d7f-45f0-4268-878b-1753e16da32e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:16.567278 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-32ba1d7f-45f0-4268-878b-1753e16da32e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:16.736757 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-32ba1d7f-45f0-4268-878b-1753e16da32e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:16.748783 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-32ba1d7f-45f0-4268-878b-1753e16da32e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:16.750925 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-32ba1d7f-45f0-4268-878b-1753e16da32e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:16.752422 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-32ba1d7f-45f0-4268-878b-1753e16da32e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1670 microversion: 2.20 time: 0.207286 Jun 06 21:11:16.753362 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 374/747] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:16 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1670 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:11:16.929924 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e286c904-f464-4aff-bf36-b22425380839 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:16.930464 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-e286c904-f464-4aff-bf36-b22425380839 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:16.938768 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e286c904-f464-4aff-bf36-b22425380839 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:16.939605 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e286c904-f464-4aff-bf36-b22425380839 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:16.940657 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e286c904-f464-4aff-bf36-b22425380839 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:16.941593 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e286c904-f464-4aff-bf36-b22425380839 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:16.984196 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-e286c904-f464-4aff-bf36-b22425380839 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab/ips" status: 200 len: 149 microversion: 2.1 time: 0.059061 Jun 06 21:11:16.984897 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 374/748] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jun 6 21:11:16 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab/ips => generated 149 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:11:17.480039 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-678dbb40-c35d-4583-9a72-711899c489ab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:17.481220 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-678dbb40-c35d-4583-9a72-711899c489ab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:17.495846 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-678dbb40-c35d-4583-9a72-711899c489ab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:17.496935 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-678dbb40-c35d-4583-9a72-711899c489ab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:17.498231 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-678dbb40-c35d-4583-9a72-711899c489ab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:17.499042 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-678dbb40-c35d-4583-9a72-711899c489ab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:17.773481 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b3bfd34d-8238-42a2-951a-d8de668f767a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:17.774223 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-b3bfd34d-8238-42a2-951a-d8de668f767a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:17.784972 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b3bfd34d-8238-42a2-951a-d8de668f767a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:17.785447 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b3bfd34d-8238-42a2-951a-d8de668f767a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:17.786752 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b3bfd34d-8238-42a2-951a-d8de668f767a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:17.787240 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b3bfd34d-8238-42a2-951a-d8de668f767a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:17.893325 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-678dbb40-c35d-4583-9a72-711899c489ab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:17.905164 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-678dbb40-c35d-4583-9a72-711899c489ab tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1574 microversion: 2.1 time: 0.432855 Jun 06 21:11:17.906239 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 375/749] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:17 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1574 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:11:18.054987 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-b3bfd34d-8238-42a2-951a-d8de668f767a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:18.063853 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-b3bfd34d-8238-42a2-951a-d8de668f767a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:18.065554 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-b3bfd34d-8238-42a2-951a-d8de668f767a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:18.067034 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-b3bfd34d-8238-42a2-951a-d8de668f767a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1728 microversion: 2.20 time: 0.299123 Jun 06 21:11:18.067697 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 375/750] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:17 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1728 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:11:18.480377 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-aab8996d-0804-4215-88a8-5ddd19ad22c8 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:11:18.483686 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-aab8996d-0804-4215-88a8-5ddd19ad22c8 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:18.486389 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-8922e79c-942a-438e-885e-06c0dbf651e3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a855014e-b7b2-4c21-b78f-aa85e7885a94"}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:11:18.487303 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-8922e79c-942a-438e-885e-06c0dbf651e3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:18.496756 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8922e79c-942a-438e-885e-06c0dbf651e3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:18.497677 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8922e79c-942a-438e-885e-06c0dbf651e3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:18.498578 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8922e79c-942a-438e-885e-06c0dbf651e3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:18.498980 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aab8996d-0804-4215-88a8-5ddd19ad22c8 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:18.499164 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8922e79c-942a-438e-885e-06c0dbf651e3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:18.499735 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aab8996d-0804-4215-88a8-5ddd19ad22c8 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:18.501122 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aab8996d-0804-4215-88a8-5ddd19ad22c8 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:18.501871 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aab8996d-0804-4215-88a8-5ddd19ad22c8 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:18.663082 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-aab8996d-0804-4215-88a8-5ddd19ad22c8 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "POST /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3/action" status: 200 len: 14 microversion: 2.1 time: 0.189000 Jun 06 21:11:18.664657 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 376/751] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 6 21:11:18 2022] POST /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3/action => generated 14 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 06 21:11:18.674303 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-056664af-ec72-4e0a-8707-f8c8aae108e1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:18.676482 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-056664af-ec72-4e0a-8707-f8c8aae108e1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:18.689025 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-056664af-ec72-4e0a-8707-f8c8aae108e1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:18.690399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-056664af-ec72-4e0a-8707-f8c8aae108e1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:18.691821 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-056664af-ec72-4e0a-8707-f8c8aae108e1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:18.692928 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-056664af-ec72-4e0a-8707-f8c8aae108e1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:18.739209 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-056664af-ec72-4e0a-8707-f8c8aae108e1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 21:11:18.905244 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-056664af-ec72-4e0a-8707-f8c8aae108e1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "DELETE /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 204 len: 0 microversion: 2.1 time: 0.237664 Jun 06 21:11:18.906379 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 377/752] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:11:18 2022] DELETE /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 21:11:18.917022 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-198a5ce2-ab26-40c4-8474-c7aace5015fb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:18.918089 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-198a5ce2-ab26-40c4-8474-c7aace5015fb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:18.926250 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-198a5ce2-ab26-40c4-8474-c7aace5015fb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:18.927109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-198a5ce2-ab26-40c4-8474-c7aace5015fb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:18.928330 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-198a5ce2-ab26-40c4-8474-c7aace5015fb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:18.929025 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-198a5ce2-ab26-40c4-8474-c7aace5015fb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:19.339328 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-198a5ce2-ab26-40c4-8474-c7aace5015fb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:19.354544 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-198a5ce2-ab26-40c4-8474-c7aace5015fb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1506 microversion: 2.1 time: 0.441391 Jun 06 21:11:19.366408 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 378/753] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:18 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1506 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:19.366408 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a55ed108-b94c-4ef4-ab14-e0d0c1510b1e tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:19.366408 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a55ed108-b94c-4ef4-ab14-e0d0c1510b1e tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:19.377455 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a55ed108-b94c-4ef4-ab14-e0d0c1510b1e tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:19.378261 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a55ed108-b94c-4ef4-ab14-e0d0c1510b1e tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:19.379650 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a55ed108-b94c-4ef4-ab14-e0d0c1510b1e tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:19.380468 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a55ed108-b94c-4ef4-ab14-e0d0c1510b1e tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:19.638209 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a55ed108-b94c-4ef4-ab14-e0d0c1510b1e tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:19.648475 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a55ed108-b94c-4ef4-ab14-e0d0c1510b1e tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1574 microversion: 2.1 time: 0.290730 Jun 06 21:11:19.649197 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 379/754] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:19 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1574 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:19.658571 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-92b7054a-9a3a-4334-a770-de78ecd0b87b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:19.659893 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-92b7054a-9a3a-4334-a770-de78ecd0b87b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:19.669937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-92b7054a-9a3a-4334-a770-de78ecd0b87b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:19.670457 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-92b7054a-9a3a-4334-a770-de78ecd0b87b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:19.671381 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-92b7054a-9a3a-4334-a770-de78ecd0b87b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:19.671905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-92b7054a-9a3a-4334-a770-de78ecd0b87b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:19.979367 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-92b7054a-9a3a-4334-a770-de78ecd0b87b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:19.994833 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-92b7054a-9a3a-4334-a770-de78ecd0b87b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:19.998667 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-92b7054a-9a3a-4334-a770-de78ecd0b87b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:20.001051 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-92b7054a-9a3a-4334-a770-de78ecd0b87b tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1728 microversion: 2.20 time: 0.350190 Jun 06 21:11:20.002214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 380/755] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:19 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1728 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:11:20.323566 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-13b0542f-72e7-40b4-9b14-4c8682b91ea0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:20.324358 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-13b0542f-72e7-40b4-9b14-4c8682b91ea0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:20.332910 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-13b0542f-72e7-40b4-9b14-4c8682b91ea0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:20.333481 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-13b0542f-72e7-40b4-9b14-4c8682b91ea0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:20.334404 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-13b0542f-72e7-40b4-9b14-4c8682b91ea0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:20.335004 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-13b0542f-72e7-40b4-9b14-4c8682b91ea0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:20.367529 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-13b0542f-72e7-40b4-9b14-4c8682b91ea0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 21:11:20.408083 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:20.464336 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-13b0542f-72e7-40b4-9b14-4c8682b91ea0 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "DELETE /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 204 len: 0 microversion: 2.1 time: 0.144288 Jun 06 21:11:20.465337 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 381/756] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:11:20 2022] DELETE /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 06 21:11:20.473821 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-643006fc-0fe9-4e8b-9950-c4c5e3ae7526 req-a355d2b5-9b3c-4e90-b364-d64aade18ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56edbb7a-b8fb-4934-a7f5-9f2cf82542a3", "tag": "0e363b5d-cbf1-4fca-be7e-728a1e94a07d"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:11:20.483109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-643006fc-0fe9-4e8b-9950-c4c5e3ae7526 req-a355d2b5-9b3c-4e90-b364-d64aade18ab8 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:20.483616 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-643006fc-0fe9-4e8b-9950-c4c5e3ae7526 req-a355d2b5-9b3c-4e90-b364-d64aade18ab8 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:20.498248 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-643006fc-0fe9-4e8b-9950-c4c5e3ae7526 req-a355d2b5-9b3c-4e90-b364-d64aade18ab8 service nova] Creating event network-changed:0e363b5d-cbf1-4fca-be7e-728a1e94a07d for instance 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 on hv-cinder-84488 Jun 06 21:11:20.504332 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-643006fc-0fe9-4e8b-9950-c4c5e3ae7526 req-a355d2b5-9b3c-4e90-b364-d64aade18ab8 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036803 Jun 06 21:11:20.504978 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 382/757] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:11:20.516818 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b78239a8-c0b9-47b0-844c-2ccbb674a9c1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:20.517309 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b78239a8-c0b9-47b0-844c-2ccbb674a9c1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:20.528543 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b78239a8-c0b9-47b0-844c-2ccbb674a9c1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:20.529270 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b78239a8-c0b9-47b0-844c-2ccbb674a9c1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:20.530617 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b78239a8-c0b9-47b0-844c-2ccbb674a9c1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:20.531379 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b78239a8-c0b9-47b0-844c-2ccbb674a9c1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:20.737600 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b78239a8-c0b9-47b0-844c-2ccbb674a9c1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:20.747422 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b78239a8-c0b9-47b0-844c-2ccbb674a9c1 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1506 microversion: 2.1 time: 0.239432 Jun 06 21:11:20.748319 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 383/758] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:20 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1506 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:20.764137 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-cd962a7c-5542-4a3e-b827-e3979617b844 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:20.764137 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-cd962a7c-5542-4a3e-b827-e3979617b844 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:20.769289 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cd962a7c-5542-4a3e-b827-e3979617b844 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:20.770328 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cd962a7c-5542-4a3e-b827-e3979617b844 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:20.771409 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cd962a7c-5542-4a3e-b827-e3979617b844 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:20.772082 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cd962a7c-5542-4a3e-b827-e3979617b844 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:20.933850 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-cd962a7c-5542-4a3e-b827-e3979617b844 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:20.943183 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-cd962a7c-5542-4a3e-b827-e3979617b844 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1578 microversion: 2.1 time: 0.193245 Jun 06 21:11:20.943928 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 384/759] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:20 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1578 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:20.949044 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2e8cf8b0-3307-41a1-a04c-4ed0783bb3a4 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:20.949656 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2e8cf8b0-3307-41a1-a04c-4ed0783bb3a4 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:20.968280 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e8cf8b0-3307-41a1-a04c-4ed0783bb3a4 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:20.968738 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e8cf8b0-3307-41a1-a04c-4ed0783bb3a4 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:20.969547 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e8cf8b0-3307-41a1-a04c-4ed0783bb3a4 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:20.969988 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e8cf8b0-3307-41a1-a04c-4ed0783bb3a4 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:21.126813 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2e8cf8b0-3307-41a1-a04c-4ed0783bb3a4 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:21.135779 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2e8cf8b0-3307-41a1-a04c-4ed0783bb3a4 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1574 microversion: 2.1 time: 0.190566 Jun 06 21:11:21.136502 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 385/760] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:20 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1574 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:21.141726 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9b231e73-40c0-4c0f-99b2-74823045e2b6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:21.142682 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9b231e73-40c0-4c0f-99b2-74823045e2b6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:21.150692 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9b231e73-40c0-4c0f-99b2-74823045e2b6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:21.151137 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9b231e73-40c0-4c0f-99b2-74823045e2b6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:21.151928 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9b231e73-40c0-4c0f-99b2-74823045e2b6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:21.152396 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9b231e73-40c0-4c0f-99b2-74823045e2b6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:21.339376 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9b231e73-40c0-4c0f-99b2-74823045e2b6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:21.350052 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9b231e73-40c0-4c0f-99b2-74823045e2b6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:21.351854 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9b231e73-40c0-4c0f-99b2-74823045e2b6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:21.353219 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9b231e73-40c0-4c0f-99b2-74823045e2b6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1728 microversion: 2.20 time: 0.215837 Jun 06 21:11:21.353886 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 386/761] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:21 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1728 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:11:21.776157 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e875c5e9-3c90-4293-8f2d-32180c6d5496 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:21.776907 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e875c5e9-3c90-4293-8f2d-32180c6d5496 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:21.785576 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e875c5e9-3c90-4293-8f2d-32180c6d5496 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:21.786024 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e875c5e9-3c90-4293-8f2d-32180c6d5496 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:21.786821 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e875c5e9-3c90-4293-8f2d-32180c6d5496 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:21.787252 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e875c5e9-3c90-4293-8f2d-32180c6d5496 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:22.099364 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e875c5e9-3c90-4293-8f2d-32180c6d5496 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:22.115670 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e875c5e9-3c90-4293-8f2d-32180c6d5496 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1506 microversion: 2.1 time: 0.344223 Jun 06 21:11:22.133771 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 387/762] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:21 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1506 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:22.140746 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a385e14b-917a-4b79-b8b4-f2eb6d860bc4 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:22.141676 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a385e14b-917a-4b79-b8b4-f2eb6d860bc4 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:22.151342 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a385e14b-917a-4b79-b8b4-f2eb6d860bc4 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:22.152168 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a385e14b-917a-4b79-b8b4-f2eb6d860bc4 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:22.153578 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a385e14b-917a-4b79-b8b4-f2eb6d860bc4 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:22.154327 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a385e14b-917a-4b79-b8b4-f2eb6d860bc4 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:22.395005 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a385e14b-917a-4b79-b8b4-f2eb6d860bc4 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:22.410456 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a385e14b-917a-4b79-b8b4-f2eb6d860bc4 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1578 microversion: 2.1 time: 0.274279 Jun 06 21:11:22.413380 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 388/763] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:22 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1578 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:22.434779 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-73feb2ee-82f4-4257-89a8-146a4e90e4f7 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:22.436031 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-73feb2ee-82f4-4257-89a8-146a4e90e4f7 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:22.447448 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-73feb2ee-82f4-4257-89a8-146a4e90e4f7 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:22.448081 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-73feb2ee-82f4-4257-89a8-146a4e90e4f7 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:22.449258 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-73feb2ee-82f4-4257-89a8-146a4e90e4f7 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:22.449967 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-73feb2ee-82f4-4257-89a8-146a4e90e4f7 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:22.666978 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-73feb2ee-82f4-4257-89a8-146a4e90e4f7 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:22.682080 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-73feb2ee-82f4-4257-89a8-146a4e90e4f7 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1574 microversion: 2.1 time: 0.266628 Jun 06 21:11:22.696750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 389/764] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:22 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1574 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:22.710314 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3a1713cb-6380-4498-8406-e1f3435f8135 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:22.711338 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3a1713cb-6380-4498-8406-e1f3435f8135 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:22.725064 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3a1713cb-6380-4498-8406-e1f3435f8135 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:22.725885 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3a1713cb-6380-4498-8406-e1f3435f8135 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:22.726883 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3a1713cb-6380-4498-8406-e1f3435f8135 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:22.727397 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3a1713cb-6380-4498-8406-e1f3435f8135 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:22.932147 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3a1713cb-6380-4498-8406-e1f3435f8135 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:22.947701 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3a1713cb-6380-4498-8406-e1f3435f8135 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:22.950337 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3a1713cb-6380-4498-8406-e1f3435f8135 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:22.953804 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3a1713cb-6380-4498-8406-e1f3435f8135 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1728 microversion: 2.20 time: 0.254479 Jun 06 21:11:22.955453 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 390/765] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:22 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1728 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:11:23.146599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fe1e4612-b1a1-4e35-be36-bb30aa86f815 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:23.147680 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fe1e4612-b1a1-4e35-be36-bb30aa86f815 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:23.159102 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe1e4612-b1a1-4e35-be36-bb30aa86f815 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:23.159930 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe1e4612-b1a1-4e35-be36-bb30aa86f815 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:23.161715 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe1e4612-b1a1-4e35-be36-bb30aa86f815 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:23.162519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe1e4612-b1a1-4e35-be36-bb30aa86f815 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:23.396677 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fe1e4612-b1a1-4e35-be36-bb30aa86f815 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:23.406246 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fe1e4612-b1a1-4e35-be36-bb30aa86f815 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1506 microversion: 2.1 time: 0.266887 Jun 06 21:11:23.408025 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 391/766] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:23 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1506 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:23.440087 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4e7428bc-5042-445b-8f8b-c5871fcb219d tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:23.444184 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4e7428bc-5042-445b-8f8b-c5871fcb219d tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:23.451022 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4e7428bc-5042-445b-8f8b-c5871fcb219d tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:23.452178 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4e7428bc-5042-445b-8f8b-c5871fcb219d tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:23.453072 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4e7428bc-5042-445b-8f8b-c5871fcb219d tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:23.453636 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4e7428bc-5042-445b-8f8b-c5871fcb219d tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:23.658473 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4e7428bc-5042-445b-8f8b-c5871fcb219d tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:23.667267 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4e7428bc-5042-445b-8f8b-c5871fcb219d tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1578 microversion: 2.1 time: 0.234702 Jun 06 21:11:23.667883 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 392/767] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:23 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1578 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:23.718123 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a619bfe5-92b5-4699-858e-08361bcac03b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:23.718741 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a619bfe5-92b5-4699-858e-08361bcac03b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:23.725241 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a619bfe5-92b5-4699-858e-08361bcac03b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:23.725670 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a619bfe5-92b5-4699-858e-08361bcac03b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:23.726453 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a619bfe5-92b5-4699-858e-08361bcac03b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:23.726877 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a619bfe5-92b5-4699-858e-08361bcac03b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:23.943511 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a619bfe5-92b5-4699-858e-08361bcac03b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:23.955406 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a619bfe5-92b5-4699-858e-08361bcac03b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1574 microversion: 2.1 time: 0.242136 Jun 06 21:11:23.956156 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 393/768] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:23 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1574 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:11:23.990708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4e1dcb41-58e9-482e-a5aa-53cfa21ffbe6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:23.994046 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4e1dcb41-58e9-482e-a5aa-53cfa21ffbe6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:24.005090 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4e1dcb41-58e9-482e-a5aa-53cfa21ffbe6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:24.005937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4e1dcb41-58e9-482e-a5aa-53cfa21ffbe6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:24.007424 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4e1dcb41-58e9-482e-a5aa-53cfa21ffbe6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:24.008315 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4e1dcb41-58e9-482e-a5aa-53cfa21ffbe6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:24.276221 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4e1dcb41-58e9-482e-a5aa-53cfa21ffbe6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:24.293612 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4e1dcb41-58e9-482e-a5aa-53cfa21ffbe6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:24.302802 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4e1dcb41-58e9-482e-a5aa-53cfa21ffbe6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:24.302802 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4e1dcb41-58e9-482e-a5aa-53cfa21ffbe6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1728 microversion: 2.20 time: 0.317117 Jun 06 21:11:24.305781 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 394/769] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:23 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1728 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:11:24.433145 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6a3033e8-fe8d-45b8-8a62-e7f820e0d122 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:24.434099 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6a3033e8-fe8d-45b8-8a62-e7f820e0d122 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:24.446152 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6a3033e8-fe8d-45b8-8a62-e7f820e0d122 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:24.446831 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6a3033e8-fe8d-45b8-8a62-e7f820e0d122 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:24.448024 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6a3033e8-fe8d-45b8-8a62-e7f820e0d122 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:24.448707 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6a3033e8-fe8d-45b8-8a62-e7f820e0d122 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:24.709164 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6a3033e8-fe8d-45b8-8a62-e7f820e0d122 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:24.723932 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6a3033e8-fe8d-45b8-8a62-e7f820e0d122 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1506 microversion: 2.1 time: 0.297915 Jun 06 21:11:24.739873 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 395/770] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:24 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1506 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:11:24.746048 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b9038c8f-473e-4e6b-9dbe-5d06923921b8 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:24.747153 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b9038c8f-473e-4e6b-9dbe-5d06923921b8 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:24.758258 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b9038c8f-473e-4e6b-9dbe-5d06923921b8 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:24.758751 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b9038c8f-473e-4e6b-9dbe-5d06923921b8 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:24.760109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b9038c8f-473e-4e6b-9dbe-5d06923921b8 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:24.760462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b9038c8f-473e-4e6b-9dbe-5d06923921b8 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:24.991143 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b9038c8f-473e-4e6b-9dbe-5d06923921b8 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:25.005838 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b9038c8f-473e-4e6b-9dbe-5d06923921b8 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1578 microversion: 2.1 time: 0.263770 Jun 06 21:11:25.023769 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 396/771] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:24 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1578 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:25.033586 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-89a24ec3-1566-40f8-82a9-314a4224913f tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:25.038589 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-89a24ec3-1566-40f8-82a9-314a4224913f tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:25.061798 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-89a24ec3-1566-40f8-82a9-314a4224913f tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:25.062516 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-89a24ec3-1566-40f8-82a9-314a4224913f tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:25.063863 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-89a24ec3-1566-40f8-82a9-314a4224913f tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:25.064605 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-89a24ec3-1566-40f8-82a9-314a4224913f tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:25.321269 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-89a24ec3-1566-40f8-82a9-314a4224913f tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:25.333678 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-89a24ec3-1566-40f8-82a9-314a4224913f tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1574 microversion: 2.1 time: 0.308352 Jun 06 21:11:25.344296 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 397/772] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:25 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1574 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:25.349879 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e89690f9-601c-4c92-8939-f07be32e6ba1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:25.350589 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e89690f9-601c-4c92-8939-f07be32e6ba1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:25.358309 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e89690f9-601c-4c92-8939-f07be32e6ba1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:25.358858 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e89690f9-601c-4c92-8939-f07be32e6ba1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:25.359754 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e89690f9-601c-4c92-8939-f07be32e6ba1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:25.360367 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e89690f9-601c-4c92-8939-f07be32e6ba1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:25.383508 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:25.616746 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e89690f9-601c-4c92-8939-f07be32e6ba1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:25.633956 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e89690f9-601c-4c92-8939-f07be32e6ba1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:25.637251 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e89690f9-601c-4c92-8939-f07be32e6ba1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:25.639482 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e89690f9-601c-4c92-8939-f07be32e6ba1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1728 microversion: 2.20 time: 0.293652 Jun 06 21:11:25.640642 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 398/773] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:25 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1728 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:11:25.751909 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5c8d9eb6-6f6f-4f06-b5e6-73ffc5ccafd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:25.752971 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5c8d9eb6-6f6f-4f06-b5e6-73ffc5ccafd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:25.762344 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5c8d9eb6-6f6f-4f06-b5e6-73ffc5ccafd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:25.763209 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5c8d9eb6-6f6f-4f06-b5e6-73ffc5ccafd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:25.764533 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5c8d9eb6-6f6f-4f06-b5e6-73ffc5ccafd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:25.765185 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5c8d9eb6-6f6f-4f06-b5e6-73ffc5ccafd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:25.949088 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5c8d9eb6-6f6f-4f06-b5e6-73ffc5ccafd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:25.979673 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5c8d9eb6-6f6f-4f06-b5e6-73ffc5ccafd5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1506 microversion: 2.1 time: 0.231765 Jun 06 21:11:25.987385 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 399/774] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:25 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1506 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:26.037314 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5b5aaf26-caaa-4e5d-8512-919e3f61269f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:26.038257 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5b5aaf26-caaa-4e5d-8512-919e3f61269f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:26.046780 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5b5aaf26-caaa-4e5d-8512-919e3f61269f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:26.047470 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5b5aaf26-caaa-4e5d-8512-919e3f61269f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:26.048713 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5b5aaf26-caaa-4e5d-8512-919e3f61269f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:26.049394 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5b5aaf26-caaa-4e5d-8512-919e3f61269f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:26.295887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5b5aaf26-caaa-4e5d-8512-919e3f61269f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:26.327358 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5b5aaf26-caaa-4e5d-8512-919e3f61269f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1578 microversion: 2.1 time: 0.298262 Jun 06 21:11:26.328923 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 400/775] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:26 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1578 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:26.352483 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0b231d53-c01b-43d1-89dc-2075f0262735 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:26.353358 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0b231d53-c01b-43d1-89dc-2075f0262735 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:26.368159 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b231d53-c01b-43d1-89dc-2075f0262735 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:26.368159 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b231d53-c01b-43d1-89dc-2075f0262735 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:26.368159 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b231d53-c01b-43d1-89dc-2075f0262735 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:26.368159 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0b231d53-c01b-43d1-89dc-2075f0262735 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:26.629930 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0b231d53-c01b-43d1-89dc-2075f0262735 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:26.648182 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0b231d53-c01b-43d1-89dc-2075f0262735 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1574 microversion: 2.1 time: 0.299661 Jun 06 21:11:26.648905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 401/776] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:26 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1574 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:26.669745 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3035d207-6eca-44bb-bee0-f4f21fe0ad14 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:26.670360 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3035d207-6eca-44bb-bee0-f4f21fe0ad14 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:26.678614 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3035d207-6eca-44bb-bee0-f4f21fe0ad14 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:26.683125 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3035d207-6eca-44bb-bee0-f4f21fe0ad14 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:26.684418 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3035d207-6eca-44bb-bee0-f4f21fe0ad14 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:26.684834 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3035d207-6eca-44bb-bee0-f4f21fe0ad14 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:26.930430 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3035d207-6eca-44bb-bee0-f4f21fe0ad14 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:26.942738 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3035d207-6eca-44bb-bee0-f4f21fe0ad14 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:26.944937 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3035d207-6eca-44bb-bee0-f4f21fe0ad14 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:26.946697 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3035d207-6eca-44bb-bee0-f4f21fe0ad14 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1728 microversion: 2.20 time: 0.282324 Jun 06 21:11:26.947524 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 402/777] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:26 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1728 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:11:27.012615 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f76c0051-1139-4b6b-83e0-3770116d4054 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:27.013234 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f76c0051-1139-4b6b-83e0-3770116d4054 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:27.020323 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f76c0051-1139-4b6b-83e0-3770116d4054 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:27.020780 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f76c0051-1139-4b6b-83e0-3770116d4054 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:27.021668 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f76c0051-1139-4b6b-83e0-3770116d4054 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:27.022288 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f76c0051-1139-4b6b-83e0-3770116d4054 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:27.245698 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f76c0051-1139-4b6b-83e0-3770116d4054 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:27.255604 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f76c0051-1139-4b6b-83e0-3770116d4054 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1506 microversion: 2.1 time: 0.247939 Jun 06 21:11:27.256313 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 403/778] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:27 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:11:27.345735 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8a9ed5ed-b7f0-4f64-9606-bbd55334edd9 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:27.346866 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8a9ed5ed-b7f0-4f64-9606-bbd55334edd9 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:27.353195 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8a9ed5ed-b7f0-4f64-9606-bbd55334edd9 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:27.355926 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8a9ed5ed-b7f0-4f64-9606-bbd55334edd9 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:27.357790 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8a9ed5ed-b7f0-4f64-9606-bbd55334edd9 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:27.358604 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8a9ed5ed-b7f0-4f64-9606-bbd55334edd9 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:27.543300 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8a9ed5ed-b7f0-4f64-9606-bbd55334edd9 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:27.557751 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8a9ed5ed-b7f0-4f64-9606-bbd55334edd9 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1578 microversion: 2.1 time: 0.215585 Jun 06 21:11:27.559269 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 404/779] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:27 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1578 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:11:27.665697 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ba89f4e7-e71f-473c-ac10-67b17b0ad905 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:27.666306 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ba89f4e7-e71f-473c-ac10-67b17b0ad905 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:27.673213 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ba89f4e7-e71f-473c-ac10-67b17b0ad905 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:27.673650 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ba89f4e7-e71f-473c-ac10-67b17b0ad905 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:27.674446 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ba89f4e7-e71f-473c-ac10-67b17b0ad905 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:27.674907 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ba89f4e7-e71f-473c-ac10-67b17b0ad905 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:27.918640 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ba89f4e7-e71f-473c-ac10-67b17b0ad905 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:27.931216 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ba89f4e7-e71f-473c-ac10-67b17b0ad905 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1574 microversion: 2.1 time: 0.269243 Jun 06 21:11:27.933992 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 405/780] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:27 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1574 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:11:27.974732 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-717e09f8-6e5b-4450-bab7-7eef40a9b4e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:27.976101 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-717e09f8-6e5b-4450-bab7-7eef40a9b4e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:27.989133 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-717e09f8-6e5b-4450-bab7-7eef40a9b4e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:27.989971 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-717e09f8-6e5b-4450-bab7-7eef40a9b4e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:27.991367 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-717e09f8-6e5b-4450-bab7-7eef40a9b4e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:27.992482 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-717e09f8-6e5b-4450-bab7-7eef40a9b4e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:28.214670 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-717e09f8-6e5b-4450-bab7-7eef40a9b4e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:28.225749 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-717e09f8-6e5b-4450-bab7-7eef40a9b4e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:28.228094 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-717e09f8-6e5b-4450-bab7-7eef40a9b4e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:28.229633 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-717e09f8-6e5b-4450-bab7-7eef40a9b4e3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1728 microversion: 2.20 time: 0.263092 Jun 06 21:11:28.242467 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 406/781] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:27 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1728 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:11:28.280684 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7488568f-4416-4b82-b69c-7db919637595 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:28.281606 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7488568f-4416-4b82-b69c-7db919637595 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:28.289804 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7488568f-4416-4b82-b69c-7db919637595 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:28.290279 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7488568f-4416-4b82-b69c-7db919637595 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:28.291090 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7488568f-4416-4b82-b69c-7db919637595 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:28.291523 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7488568f-4416-4b82-b69c-7db919637595 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:28.493862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=15 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:28.515254 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7488568f-4416-4b82-b69c-7db919637595 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:28.525034 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7488568f-4416-4b82-b69c-7db919637595 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1506 microversion: 2.1 time: 0.249185 Jun 06 21:11:28.525640 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 407/782] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:28 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1506 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:28.579308 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c49f1f17-3729-4d57-aba3-9fe76f44eb37 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:28.580336 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c49f1f17-3729-4d57-aba3-9fe76f44eb37 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:28.588350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c49f1f17-3729-4d57-aba3-9fe76f44eb37 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:28.588350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c49f1f17-3729-4d57-aba3-9fe76f44eb37 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:28.589076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c49f1f17-3729-4d57-aba3-9fe76f44eb37 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:28.589713 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c49f1f17-3729-4d57-aba3-9fe76f44eb37 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:28.650010 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:28.777440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c49f1f17-3729-4d57-aba3-9fe76f44eb37 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:28.786246 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c49f1f17-3729-4d57-aba3-9fe76f44eb37 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1578 microversion: 2.1 time: 0.211800 Jun 06 21:11:28.786887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 408/783] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:28 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1578 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:11:28.958951 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-85875cda-0b6e-449a-8445-a3d6005fe15a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:28.959603 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-85875cda-0b6e-449a-8445-a3d6005fe15a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:28.967453 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85875cda-0b6e-449a-8445-a3d6005fe15a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:28.968901 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85875cda-0b6e-449a-8445-a3d6005fe15a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:28.968901 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85875cda-0b6e-449a-8445-a3d6005fe15a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:28.969331 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-85875cda-0b6e-449a-8445-a3d6005fe15a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:29.131443 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-85875cda-0b6e-449a-8445-a3d6005fe15a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:29.140422 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-85875cda-0b6e-449a-8445-a3d6005fe15a tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1574 microversion: 2.1 time: 0.185355 Jun 06 21:11:29.141125 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 409/784] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:28 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1574 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:11:29.249924 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fdb61d9a-b224-46a0-a77b-bdbf05a03d7f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:29.250537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fdb61d9a-b224-46a0-a77b-bdbf05a03d7f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:29.258034 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fdb61d9a-b224-46a0-a77b-bdbf05a03d7f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:29.258486 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fdb61d9a-b224-46a0-a77b-bdbf05a03d7f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:29.259277 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fdb61d9a-b224-46a0-a77b-bdbf05a03d7f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:29.259713 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fdb61d9a-b224-46a0-a77b-bdbf05a03d7f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:29.424401 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fdb61d9a-b224-46a0-a77b-bdbf05a03d7f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:29.433791 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fdb61d9a-b224-46a0-a77b-bdbf05a03d7f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:29.435353 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fdb61d9a-b224-46a0-a77b-bdbf05a03d7f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:29.436623 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fdb61d9a-b224-46a0-a77b-bdbf05a03d7f tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1728 microversion: 2.20 time: 0.190956 Jun 06 21:11:29.437213 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 410/785] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:29 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1728 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:11:29.543227 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9ceb0ed4-cb42-4342-84b0-2243ddb445ec tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:29.544339 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9ceb0ed4-cb42-4342-84b0-2243ddb445ec tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:29.550932 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9ceb0ed4-cb42-4342-84b0-2243ddb445ec tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:29.551471 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9ceb0ed4-cb42-4342-84b0-2243ddb445ec tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:29.552516 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9ceb0ed4-cb42-4342-84b0-2243ddb445ec tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:29.553010 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9ceb0ed4-cb42-4342-84b0-2243ddb445ec tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:29.711571 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-9ceb0ed4-cb42-4342-84b0-2243ddb445ec tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:29.720283 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9ceb0ed4-cb42-4342-84b0-2243ddb445ec tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1506 microversion: 2.1 time: 0.180983 Jun 06 21:11:29.720902 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 411/786] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:29 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:11:29.808611 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7cd337bb-d267-40f3-b6d5-5e9a9539fb32 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:29.809239 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7cd337bb-d267-40f3-b6d5-5e9a9539fb32 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:29.811364 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:29.818245 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7cd337bb-d267-40f3-b6d5-5e9a9539fb32 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:29.818723 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7cd337bb-d267-40f3-b6d5-5e9a9539fb32 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:29.819605 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7cd337bb-d267-40f3-b6d5-5e9a9539fb32 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:29.820075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7cd337bb-d267-40f3-b6d5-5e9a9539fb32 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:29.973991 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-7cd337bb-d267-40f3-b6d5-5e9a9539fb32 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:29.981960 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7cd337bb-d267-40f3-b6d5-5e9a9539fb32 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1578 microversion: 2.1 time: 0.177238 Jun 06 21:11:29.982691 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 412/787] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:29 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1578 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:11:30.157938 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-60a97cc1-7808-4afe-9c09-6150cf4ef66c tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:30.158552 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-60a97cc1-7808-4afe-9c09-6150cf4ef66c tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:30.165529 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-60a97cc1-7808-4afe-9c09-6150cf4ef66c tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:30.166020 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-60a97cc1-7808-4afe-9c09-6150cf4ef66c tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:30.167051 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-60a97cc1-7808-4afe-9c09-6150cf4ef66c tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:30.167734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-60a97cc1-7808-4afe-9c09-6150cf4ef66c tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:30.324058 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-60a97cc1-7808-4afe-9c09-6150cf4ef66c tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:30.335970 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-60a97cc1-7808-4afe-9c09-6150cf4ef66c tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1574 microversion: 2.1 time: 0.181733 Jun 06 21:11:30.336945 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 413/788] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:30 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1574 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:11:30.465042 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c966c551-6944-42df-b89e-21e36d74f8d3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:30.465602 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c966c551-6944-42df-b89e-21e36d74f8d3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:30.474022 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c966c551-6944-42df-b89e-21e36d74f8d3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:30.474627 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c966c551-6944-42df-b89e-21e36d74f8d3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:30.475622 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c966c551-6944-42df-b89e-21e36d74f8d3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:30.476190 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c966c551-6944-42df-b89e-21e36d74f8d3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:30.655517 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c966c551-6944-42df-b89e-21e36d74f8d3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:30.674203 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c966c551-6944-42df-b89e-21e36d74f8d3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:30.674791 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c966c551-6944-42df-b89e-21e36d74f8d3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:30.677135 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c966c551-6944-42df-b89e-21e36d74f8d3 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1728 microversion: 2.20 time: 0.216684 Jun 06 21:11:30.688372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 414/789] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:30 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1728 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:11:30.743617 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ff1926bb-d27e-41f0-af50-8b32d179c064 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:30.744891 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ff1926bb-d27e-41f0-af50-8b32d179c064 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:30.756461 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ff1926bb-d27e-41f0-af50-8b32d179c064 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:30.757206 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ff1926bb-d27e-41f0-af50-8b32d179c064 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:30.758578 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ff1926bb-d27e-41f0-af50-8b32d179c064 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:30.759304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ff1926bb-d27e-41f0-af50-8b32d179c064 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:30.767234 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=100 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:30.858369 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-8922e79c-942a-438e-885e-06c0dbf651e3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "POST /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 12.377925 Jun 06 21:11:30.859389 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 376/790] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 6 21:11:18 2022] POST /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab/os-volume_attachments => generated 194 bytes in 12381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:11:30.977024 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ff1926bb-d27e-41f0-af50-8b32d179c064 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:30.991315 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ff1926bb-d27e-41f0-af50-8b32d179c064 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1506 microversion: 2.1 time: 0.256078 Jun 06 21:11:30.992369 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 415/791] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:30 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1506 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:31.007650 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-110d7eb7-31df-4e1a-ad9c-4cd2f1d53c9f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:31.008784 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-110d7eb7-31df-4e1a-ad9c-4cd2f1d53c9f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:31.016984 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-110d7eb7-31df-4e1a-ad9c-4cd2f1d53c9f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:31.017625 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-110d7eb7-31df-4e1a-ad9c-4cd2f1d53c9f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:31.018292 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-110d7eb7-31df-4e1a-ad9c-4cd2f1d53c9f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:31.019011 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-110d7eb7-31df-4e1a-ad9c-4cd2f1d53c9f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:31.202763 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-110d7eb7-31df-4e1a-ad9c-4cd2f1d53c9f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:31.211303 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-110d7eb7-31df-4e1a-ad9c-4cd2f1d53c9f tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1578 microversion: 2.1 time: 0.213014 Jun 06 21:11:31.211949 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 377/792] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:30 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1578 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:31.354757 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4a672b7a-f8ae-45d8-a5af-274c3e88cafa tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:31.355637 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4a672b7a-f8ae-45d8-a5af-274c3e88cafa tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:31.365102 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a672b7a-f8ae-45d8-a5af-274c3e88cafa tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:31.365805 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a672b7a-f8ae-45d8-a5af-274c3e88cafa tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:31.366909 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a672b7a-f8ae-45d8-a5af-274c3e88cafa tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:31.367523 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4a672b7a-f8ae-45d8-a5af-274c3e88cafa tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:31.554568 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4a672b7a-f8ae-45d8-a5af-274c3e88cafa tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:31.563955 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4a672b7a-f8ae-45d8-a5af-274c3e88cafa tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1574 microversion: 2.1 time: 0.213495 Jun 06 21:11:31.564879 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 416/793] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:31 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1574 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:31.699983 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-8c48a5a0-ebe2-49f0-b6a5-44c16832920c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:31.700766 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-8c48a5a0-ebe2-49f0-b6a5-44c16832920c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:31.711331 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8c48a5a0-ebe2-49f0-b6a5-44c16832920c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:31.711756 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8c48a5a0-ebe2-49f0-b6a5-44c16832920c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:31.712688 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8c48a5a0-ebe2-49f0-b6a5-44c16832920c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:31.713126 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8c48a5a0-ebe2-49f0-b6a5-44c16832920c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:31.906740 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-8c48a5a0-ebe2-49f0-b6a5-44c16832920c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:31.920335 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-8c48a5a0-ebe2-49f0-b6a5-44c16832920c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:31.923313 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-8c48a5a0-ebe2-49f0-b6a5-44c16832920c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:31.925403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-8c48a5a0-ebe2-49f0-b6a5-44c16832920c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1728 microversion: 2.20 time: 0.231703 Jun 06 21:11:31.926110 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 378/794] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:31 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1728 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:11:32.022374 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-94a2bee0-e26c-4c9e-b267-329d0c9480b5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:32.024734 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-94a2bee0-e26c-4c9e-b267-329d0c9480b5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:32.036529 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-94a2bee0-e26c-4c9e-b267-329d0c9480b5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:32.037694 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-94a2bee0-e26c-4c9e-b267-329d0c9480b5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:32.039300 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-94a2bee0-e26c-4c9e-b267-329d0c9480b5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:32.040409 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-94a2bee0-e26c-4c9e-b267-329d0c9480b5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:32.081468 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-84417764-e069-4267-bc68-6a746964ba5e req-cc4e3856-6b05-4771-889f-020cf3a7085f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fecd9b3-66d5-4e24-bad4-2d483ea3c7af", "name": "network-vif-deleted", "tag": "b95d8a9d-3d6a-440d-8dd9-e5bc4da3d13d"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:11:32.097364 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-84417764-e069-4267-bc68-6a746964ba5e req-cc4e3856-6b05-4771-889f-020cf3a7085f service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:32.098167 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-84417764-e069-4267-bc68-6a746964ba5e req-cc4e3856-6b05-4771-889f-020cf3a7085f service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:32.116441 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-84417764-e069-4267-bc68-6a746964ba5e req-cc4e3856-6b05-4771-889f-020cf3a7085f service nova] Creating event network-vif-deleted:b95d8a9d-3d6a-440d-8dd9-e5bc4da3d13d for instance 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af on hv-cinder-84488 Jun 06 21:11:32.122003 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-84417764-e069-4267-bc68-6a746964ba5e req-cc4e3856-6b05-4771-889f-020cf3a7085f service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047823 Jun 06 21:11:32.122982 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 379/795] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:11:32.155656 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-94a2bee0-e26c-4c9e-b267-329d0c9480b5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:32.165261 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-94a2bee0-e26c-4c9e-b267-329d0c9480b5 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1464 microversion: 2.1 time: 0.151870 Jun 06 21:11:32.165863 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 417/796] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:32 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1464 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:32.229376 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-4ad9fef1-2422-4a84-81b4-d839c7430f7e tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:32.230078 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-4ad9fef1-2422-4a84-81b4-d839c7430f7e tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:32.238369 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4ad9fef1-2422-4a84-81b4-d839c7430f7e tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:32.238872 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4ad9fef1-2422-4a84-81b4-d839c7430f7e tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:32.239700 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4ad9fef1-2422-4a84-81b4-d839c7430f7e tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:32.240169 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4ad9fef1-2422-4a84-81b4-d839c7430f7e tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:32.590134 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2da8451b-4bcb-4ae1-b6d6-c5d045fd0669 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:32.591147 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2da8451b-4bcb-4ae1-b6d6-c5d045fd0669 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:32.600352 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2da8451b-4bcb-4ae1-b6d6-c5d045fd0669 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:32.601042 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2da8451b-4bcb-4ae1-b6d6-c5d045fd0669 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:32.602289 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2da8451b-4bcb-4ae1-b6d6-c5d045fd0669 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:32.602832 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2da8451b-4bcb-4ae1-b6d6-c5d045fd0669 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:32.627295 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-4ad9fef1-2422-4a84-81b4-d839c7430f7e tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:32.638574 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-4ad9fef1-2422-4a84-81b4-d839c7430f7e tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1578 microversion: 2.1 time: 0.413102 Jun 06 21:11:32.639232 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 380/797] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:32 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1578 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:32.823973 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2da8451b-4bcb-4ae1-b6d6-c5d045fd0669 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:32.838824 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2da8451b-4bcb-4ae1-b6d6-c5d045fd0669 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1574 microversion: 2.1 time: 0.254727 Jun 06 21:11:32.841385 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 418/798] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:32 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1574 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:11:32.947614 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-d3edbb96-d445-49f7-9392-72973be83233 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:32.948496 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-d3edbb96-d445-49f7-9392-72973be83233 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:32.957340 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d3edbb96-d445-49f7-9392-72973be83233 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:32.957970 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d3edbb96-d445-49f7-9392-72973be83233 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:32.959562 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d3edbb96-d445-49f7-9392-72973be83233 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:32.960241 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d3edbb96-d445-49f7-9392-72973be83233 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:33.139065 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-d3edbb96-d445-49f7-9392-72973be83233 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:33.150434 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-d3edbb96-d445-49f7-9392-72973be83233 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:33.152295 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-d3edbb96-d445-49f7-9392-72973be83233 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:33.154281 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-d3edbb96-d445-49f7-9392-72973be83233 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1728 microversion: 2.20 time: 0.212347 Jun 06 21:11:33.155105 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 381/799] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:32 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1728 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:11:33.187941 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-363f4cd6-4c17-443d-95f4-b1924b5a2feb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:33.189602 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-363f4cd6-4c17-443d-95f4-b1924b5a2feb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:33.202823 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-363f4cd6-4c17-443d-95f4-b1924b5a2feb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:33.203465 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-363f4cd6-4c17-443d-95f4-b1924b5a2feb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:33.204627 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-363f4cd6-4c17-443d-95f4-b1924b5a2feb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:33.205283 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-363f4cd6-4c17-443d-95f4-b1924b5a2feb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:33.271075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-363f4cd6-4c17-443d-95f4-b1924b5a2feb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:33.271696 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-363f4cd6-4c17-443d-95f4-b1924b5a2feb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:33.272880 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-363f4cd6-4c17-443d-95f4-b1924b5a2feb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lazy-loading 'fault' on Instance uuid 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:11:33.323614 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-363f4cd6-4c17-443d-95f4-b1924b5a2feb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:33.332257 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-363f4cd6-4c17-443d-95f4-b1924b5a2feb tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 200 len: 1312 microversion: 2.1 time: 0.152978 Jun 06 21:11:33.332876 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 419/800] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:33 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:33.667573 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-d537c267-a523-4172-9bdc-058dd4d950a4 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:33.670422 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-d537c267-a523-4172-9bdc-058dd4d950a4 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:33.688860 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d537c267-a523-4172-9bdc-058dd4d950a4 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:33.690025 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d537c267-a523-4172-9bdc-058dd4d950a4 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:33.691520 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d537c267-a523-4172-9bdc-058dd4d950a4 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:33.692325 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d537c267-a523-4172-9bdc-058dd4d950a4 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:33.882866 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-09c85d65-bd59-4894-9596-919992f480bd tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:33.887326 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-09c85d65-bd59-4894-9596-919992f480bd tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:33.903354 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-09c85d65-bd59-4894-9596-919992f480bd tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:33.904276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-09c85d65-bd59-4894-9596-919992f480bd tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:33.905947 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-09c85d65-bd59-4894-9596-919992f480bd tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:33.906852 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-09c85d65-bd59-4894-9596-919992f480bd tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:34.055213 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-d537c267-a523-4172-9bdc-058dd4d950a4 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:34.065708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-d537c267-a523-4172-9bdc-058dd4d950a4 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1578 microversion: 2.1 time: 0.408825 Jun 06 21:11:34.066782 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 382/801] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:33 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1578 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:11:34.163680 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-ca4457fd-64d6-471c-89dc-8b8531a14924 req-3a5630c2-4ad0-42c0-a64e-6a900f1003db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56edbb7a-b8fb-4934-a7f5-9f2cf82542a3", "name": "network-vif-deleted", "tag": "0e363b5d-cbf1-4fca-be7e-728a1e94a07d"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:11:34.204787 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-ca4457fd-64d6-471c-89dc-8b8531a14924 req-3a5630c2-4ad0-42c0-a64e-6a900f1003db service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:34.204787 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-ca4457fd-64d6-471c-89dc-8b8531a14924 req-3a5630c2-4ad0-42c0-a64e-6a900f1003db service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:34.223840 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-09c85d65-bd59-4894-9596-919992f480bd tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:34.225356 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-ca4457fd-64d6-471c-89dc-8b8531a14924 req-3a5630c2-4ad0-42c0-a64e-6a900f1003db service nova] Creating event network-vif-deleted:0e363b5d-cbf1-4fca-be7e-728a1e94a07d for instance 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 on hv-cinder-84488 Jun 06 21:11:34.234940 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-09c85d65-bd59-4894-9596-919992f480bd tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1574 microversion: 2.1 time: 0.370051 Jun 06 21:11:34.236278 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-ca4457fd-64d6-471c-89dc-8b8531a14924 req-3a5630c2-4ad0-42c0-a64e-6a900f1003db service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095672 Jun 06 21:11:34.238808 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 383/802] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:11:34.247366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 420/803] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:33 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1574 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:34.249484 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-c92da153-a5d8-45e9-b613-6437e612794e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:34.250792 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-c92da153-a5d8-45e9-b613-6437e612794e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:34.266938 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c92da153-a5d8-45e9-b613-6437e612794e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:34.268101 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c92da153-a5d8-45e9-b613-6437e612794e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:34.270583 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c92da153-a5d8-45e9-b613-6437e612794e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:34.271401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c92da153-a5d8-45e9-b613-6437e612794e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:34.359087 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f2a1a9b2-8ef3-4e13-b275-f33bac16a591 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:34.360227 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f2a1a9b2-8ef3-4e13-b275-f33bac16a591 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:34.376922 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f2a1a9b2-8ef3-4e13-b275-f33bac16a591 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:34.377614 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f2a1a9b2-8ef3-4e13-b275-f33bac16a591 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:34.380313 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f2a1a9b2-8ef3-4e13-b275-f33bac16a591 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:34.381120 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f2a1a9b2-8ef3-4e13-b275-f33bac16a591 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:34.411704 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-f2a1a9b2-8ef3-4e13-b275-f33bac16a591 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] HTTP exception thrown: Instance 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af could not be found. Jun 06 21:11:34.413690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f2a1a9b2-8ef3-4e13-b275-f33bac16a591 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Request method failure captured: Jun 06 21:11:34.413690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af HTTP/1.1 Jun 06 21:11:34.413690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:11:34.413690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:11:34.413690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:11:34.413690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:11:34.413690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:11:34.413690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:11:34.413690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:11:34.413690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:11:34.413690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinmw5kgLR6NMd10ofnxehsGJrZH5eihmOg4VV2rlqBjZwvfhUx8kow_T1NaOr6zNm6K1jJsuYEhS0J5QDngP2LhFXAmzwJ6InRv6t8Nhyq76ejvBrCHdAnd0U1eHtmfrOhv9AMEP1mJ0K9M-NNm9AUbkBVRKPRAi4NyD11SlCUna2Q5g Jun 06 21:11:34.413690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:11:34.413690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:11:34.413690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:11:34.413690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:11:34.413690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:11:34.413690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:11:34.413690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: f0246519bc2240cf8d1ba54172c0faca Jun 06 21:11:34.413690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-615855304 Jun 06 21:11:34.413690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:11:34.413690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:11:34.416821 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0246519bc2240cf8d1ba54172c0faca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f0246519bc2240cf8d1ba54172c0faca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f0246519bc2240cf8d1ba54172c0faca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0246519bc2240cf8d1ba54172c0faca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:11:34.416821 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-ServerRescueNegativeTestJSON-615855304 Jun 06 21:11:34.416821 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: f0246519bc2240cf8d1ba54172c0faca Jun 06 21:11:34.416821 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-615855304 Jun 06 21:11:34.416821 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-ServerRescueNegativeTestJSON-615855304-project Jun 06 21:11:34.416821 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:11:34.416821 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:11:34.416821 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: ab9da673f40b4e3eb541fdc380cfe282 Jun 06 21:11:34.416821 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-ServerRescueNegativeTestJSON-615855304-project Jun 06 21:11:34.416821 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: > Jun 06 21:11:34.416821 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Instance 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af could not be found. Jun 06 21:11:34.416821 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '0fecd9b3-66d5-4e24-bad4-2d483ea3c7af'} Jun 06 21:11:34.418554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:11:34.418554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:34.418554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:11:34.418554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:11:34.418554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:11:34.418554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:11:34.418554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:11:34.418554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:11:34.418554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:11:34.418554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:11:34.418554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af could not be found. Jun 06 21:11:34.418554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:34.418554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:34.418554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:34.418554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:34.418554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:34.418554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:34.418554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:11:34.418554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:11:34.418554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:11:34.424616 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:11:34.424616 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:11:34.424616 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:11:34.424616 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:11:34.424616 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:11:34.424616 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:11:34.424616 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:11:34.424616 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af could not be found. Jun 06 21:11:34.424616 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:34.424616 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:34.424616 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:34.424616 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:34.424616 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:34.424616 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:34.424616 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:11:34.424616 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:11:34.424616 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af could not be found. Jun 06 21:11:34.424616 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:34.428577 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f2a1a9b2-8ef3-4e13-b275-f33bac16a591 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Returning 404 to user: Instance 0fecd9b3-66d5-4e24-bad4-2d483ea3c7af could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:11:34.428577 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f2a1a9b2-8ef3-4e13-b275-f33bac16a591 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af" status: 404 len: 111 microversion: 2.1 time: 0.065727 Jun 06 21:11:34.428577 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 421/804] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:34 2022] GET /compute/v2.1/servers/0fecd9b3-66d5-4e24-bad4-2d483ea3c7af => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:11:34.428577 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a13b9123-6f25-4e6b-93f6-baebb33cd8bf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:34.428577 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a13b9123-6f25-4e6b-93f6-baebb33cd8bf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:34.433416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a13b9123-6f25-4e6b-93f6-baebb33cd8bf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:34.433801 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a13b9123-6f25-4e6b-93f6-baebb33cd8bf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:34.434655 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a13b9123-6f25-4e6b-93f6-baebb33cd8bf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:34.435042 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a13b9123-6f25-4e6b-93f6-baebb33cd8bf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:34.482642 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a13b9123-6f25-4e6b-93f6-baebb33cd8bf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 21:11:34.640558 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a13b9123-6f25-4e6b-93f6-baebb33cd8bf tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 204 len: 0 microversion: 2.1 time: 0.220235 Jun 06 21:11:34.641847 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 422/805] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:11:34 2022] DELETE /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 21:11:34.652411 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-523e94e9-42aa-48e2-b59d-7a69c205b1c8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:34.653287 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-523e94e9-42aa-48e2-b59d-7a69c205b1c8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:34.661838 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-523e94e9-42aa-48e2-b59d-7a69c205b1c8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:34.662923 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-523e94e9-42aa-48e2-b59d-7a69c205b1c8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:34.664099 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-523e94e9-42aa-48e2-b59d-7a69c205b1c8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:34.664704 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-523e94e9-42aa-48e2-b59d-7a69c205b1c8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:34.711249 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c92da153-a5d8-45e9-b613-6437e612794e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:34.724707 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c92da153-a5d8-45e9-b613-6437e612794e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:34.726444 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c92da153-a5d8-45e9-b613-6437e612794e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:34.728024 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-c92da153-a5d8-45e9-b613-6437e612794e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1728 microversion: 2.20 time: 0.486654 Jun 06 21:11:34.742096 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 384/806] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:34 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1728 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:11:34.862081 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-523e94e9-42aa-48e2-b59d-7a69c205b1c8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:34.872988 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-523e94e9-42aa-48e2-b59d-7a69c205b1c8 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.225347 Jun 06 21:11:34.878673 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 423/807] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:34 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:11:35.094568 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-192bbf0b-cc12-4a0e-9491-6fa64565301c tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:35.095633 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-192bbf0b-cc12-4a0e-9491-6fa64565301c tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:35.105330 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-192bbf0b-cc12-4a0e-9491-6fa64565301c tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:35.106124 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-192bbf0b-cc12-4a0e-9491-6fa64565301c tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:35.107480 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-192bbf0b-cc12-4a0e-9491-6fa64565301c tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:35.108136 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-192bbf0b-cc12-4a0e-9491-6fa64565301c tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:35.159355 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-192bbf0b-cc12-4a0e-9491-6fa64565301c tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:35.159793 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-192bbf0b-cc12-4a0e-9491-6fa64565301c tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:35.160524 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.objects.instance [None req-192bbf0b-cc12-4a0e-9491-6fa64565301c tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lazy-loading 'fault' on Instance uuid 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 {{(pid=117860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:11:35.221228 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-192bbf0b-cc12-4a0e-9491-6fa64565301c tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:35.235746 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-192bbf0b-cc12-4a0e-9491-6fa64565301c tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1231 microversion: 2.1 time: 0.145388 Jun 06 21:11:35.236902 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 385/808] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:35 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1231 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:35.254232 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c8d2e18b-a162-44e2-9863-b1304f46ef93 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:35.255009 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c8d2e18b-a162-44e2-9863-b1304f46ef93 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:35.263676 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8d2e18b-a162-44e2-9863-b1304f46ef93 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:35.264253 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8d2e18b-a162-44e2-9863-b1304f46ef93 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:35.265080 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8d2e18b-a162-44e2-9863-b1304f46ef93 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:35.265585 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c8d2e18b-a162-44e2-9863-b1304f46ef93 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:35.428799 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c8d2e18b-a162-44e2-9863-b1304f46ef93 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:35.439709 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c8d2e18b-a162-44e2-9863-b1304f46ef93 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1574 microversion: 2.1 time: 0.190483 Jun 06 21:11:35.441238 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 424/809] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:35 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1574 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:35.750825 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e426454c-299b-4b63-865b-4c108a0c32d9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:35.751425 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-e426454c-299b-4b63-865b-4c108a0c32d9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:35.762012 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e426454c-299b-4b63-865b-4c108a0c32d9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:35.762782 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e426454c-299b-4b63-865b-4c108a0c32d9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:35.764237 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e426454c-299b-4b63-865b-4c108a0c32d9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:35.764976 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e426454c-299b-4b63-865b-4c108a0c32d9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:35.896153 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-56626a90-27cf-4b51-aa13-5c1f0c8ccf16 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:35.897184 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-56626a90-27cf-4b51-aa13-5c1f0c8ccf16 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:35.904945 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-56626a90-27cf-4b51-aa13-5c1f0c8ccf16 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:35.905697 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-56626a90-27cf-4b51-aa13-5c1f0c8ccf16 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:35.906839 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-56626a90-27cf-4b51-aa13-5c1f0c8ccf16 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:35.907439 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-56626a90-27cf-4b51-aa13-5c1f0c8ccf16 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:35.985833 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e426454c-299b-4b63-865b-4c108a0c32d9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:35.997289 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e426454c-299b-4b63-865b-4c108a0c32d9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:35.999420 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e426454c-299b-4b63-865b-4c108a0c32d9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:36.001086 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-e426454c-299b-4b63-865b-4c108a0c32d9 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1728 microversion: 2.20 time: 0.254954 Jun 06 21:11:36.001676 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 386/810] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:35 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1728 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:11:36.088302 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-56626a90-27cf-4b51-aa13-5c1f0c8ccf16 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:36.097075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-56626a90-27cf-4b51-aa13-5c1f0c8ccf16 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.205940 Jun 06 21:11:36.097665 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 425/811] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:35 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:11:36.262740 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-25cf4932-20ef-43ff-aba5-9b35caae20d7 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:36.263687 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-25cf4932-20ef-43ff-aba5-9b35caae20d7 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:36.272599 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-25cf4932-20ef-43ff-aba5-9b35caae20d7 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:36.273231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-25cf4932-20ef-43ff-aba5-9b35caae20d7 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:36.274064 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-25cf4932-20ef-43ff-aba5-9b35caae20d7 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:36.274644 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-25cf4932-20ef-43ff-aba5-9b35caae20d7 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:36.311893 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-25cf4932-20ef-43ff-aba5-9b35caae20d7 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:36.312416 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-25cf4932-20ef-43ff-aba5-9b35caae20d7 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:36.312853 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.objects.instance [None req-25cf4932-20ef-43ff-aba5-9b35caae20d7 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lazy-loading 'fault' on Instance uuid 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 {{(pid=117860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:11:36.361102 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-25cf4932-20ef-43ff-aba5-9b35caae20d7 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67481128d30049d29d5f0e66b1a4c970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370f0df7dc4745edb578a5f922c0f57f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:36.369929 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-25cf4932-20ef-43ff-aba5-9b35caae20d7 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 200 len: 1231 microversion: 2.1 time: 0.112629 Jun 06 21:11:36.370527 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 387/812] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:36 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 1231 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:36.464363 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2cf9629c-fcb9-490a-bf9f-76567a89d157 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:36.465589 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2cf9629c-fcb9-490a-bf9f-76567a89d157 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:36.477572 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2cf9629c-fcb9-490a-bf9f-76567a89d157 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:36.478330 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2cf9629c-fcb9-490a-bf9f-76567a89d157 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:36.479724 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2cf9629c-fcb9-490a-bf9f-76567a89d157 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:36.480531 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2cf9629c-fcb9-490a-bf9f-76567a89d157 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:36.666152 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2cf9629c-fcb9-490a-bf9f-76567a89d157 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:36.678126 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2cf9629c-fcb9-490a-bf9f-76567a89d157 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1574 microversion: 2.1 time: 0.221094 Jun 06 21:11:36.678728 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 426/813] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:36 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1574 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:11:36.818559 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-5b674cdb-22a4-4205-b9f4-b5b1124c074a req-de02f53f-a57c-4ebf-9e44-618df363bc3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5670bfe4-7e75-44cc-93c9-59dbaad0a0b2", "name": "network-vif-plugged", "status": "completed", "tag": "04c1ea5e-e07f-49da-aad5-775bd6da5cac"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:11:36.841231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-5b674cdb-22a4-4205-b9f4-b5b1124c074a req-de02f53f-a57c-4ebf-9e44-618df363bc3a service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:36.842816 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-5b674cdb-22a4-4205-b9f4-b5b1124c074a req-de02f53f-a57c-4ebf-9e44-618df363bc3a service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:36.872307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-5b674cdb-22a4-4205-b9f4-b5b1124c074a req-de02f53f-a57c-4ebf-9e44-618df363bc3a service nova] Creating event network-vif-plugged:04c1ea5e-e07f-49da-aad5-775bd6da5cac for instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 on hv-cinder-84488 Jun 06 21:11:36.882666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-5b674cdb-22a4-4205-b9f4-b5b1124c074a req-de02f53f-a57c-4ebf-9e44-618df363bc3a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069308 Jun 06 21:11:36.884577 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 388/814] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:11:37.024840 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bece14c3-607b-4681-8983-dcfd2815d21d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:37.025641 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bece14c3-607b-4681-8983-dcfd2815d21d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:37.035295 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bece14c3-607b-4681-8983-dcfd2815d21d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:37.036294 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bece14c3-607b-4681-8983-dcfd2815d21d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:37.037536 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bece14c3-607b-4681-8983-dcfd2815d21d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:37.038419 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bece14c3-607b-4681-8983-dcfd2815d21d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:37.125245 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-f6635b6a-df3d-4914-a1c7-3e7aaa9a455d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:37.125846 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-f6635b6a-df3d-4914-a1c7-3e7aaa9a455d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:37.134711 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f6635b6a-df3d-4914-a1c7-3e7aaa9a455d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:37.135234 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f6635b6a-df3d-4914-a1c7-3e7aaa9a455d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:37.136060 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f6635b6a-df3d-4914-a1c7-3e7aaa9a455d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:37.137695 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f6635b6a-df3d-4914-a1c7-3e7aaa9a455d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:37.258510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bece14c3-607b-4681-8983-dcfd2815d21d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:37.281950 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bece14c3-607b-4681-8983-dcfd2815d21d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:37.286943 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bece14c3-607b-4681-8983-dcfd2815d21d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:37.289989 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bece14c3-607b-4681-8983-dcfd2815d21d tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1728 microversion: 2.20 time: 0.270193 Jun 06 21:11:37.291446 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 427/815] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:37 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1728 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:11:37.393020 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1a948e3e-11c4-4c1d-b095-fa9ac0b27384 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:37.394333 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1a948e3e-11c4-4c1d-b095-fa9ac0b27384 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] [instance: 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:37.420383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a948e3e-11c4-4c1d-b095-fa9ac0b27384 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:37.420383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a948e3e-11c4-4c1d-b095-fa9ac0b27384 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:37.423433 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a948e3e-11c4-4c1d-b095-fa9ac0b27384 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:37.428237 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a948e3e-11c4-4c1d-b095-fa9ac0b27384 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:37.447207 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-1a948e3e-11c4-4c1d-b095-fa9ac0b27384 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] HTTP exception thrown: Instance 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 could not be found. Jun 06 21:11:37.448708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1a948e3e-11c4-4c1d-b095-fa9ac0b27384 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Request method failure captured: Jun 06 21:11:37.448708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 HTTP/1.1 Jun 06 21:11:37.448708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:11:37.448708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:11:37.448708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:11:37.448708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:11:37.448708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:11:37.448708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:11:37.448708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:11:37.448708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:11:37.448708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinmxVTZV1nal0l3xtzzuk2n0aKDyaVM7hHwRmIShniPG010DAZT1wUXYIsowvuGoAaqqnI2U0fMO3xXwurWpSb6bscOs-n6IuD8_ssCkS0MS52KJHyjApynmK1mbXf_LiYpsc2SjQwedg_ISrrjZw2N1-kKoo5Gpd0f8rtBx8iwAY0nY Jun 06 21:11:37.448708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:11:37.448708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:11:37.448708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:11:37.448708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:11:37.448708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:11:37.448708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:11:37.448708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 370f0df7dc4745edb578a5f922c0f57f Jun 06 21:11:37.448708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-TestVolumeBootPattern-616441716 Jun 06 21:11:37.448708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:11:37.448708 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:11:37.450303 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/370f0df7dc4745edb578a5f922c0f57f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_370f0df7dc4745edb578a5f922c0f57f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/370f0df7dc4745edb578a5f922c0f57f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/370f0df7dc4745edb578a5f922c0f57f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:11:37.450303 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-TestVolumeBootPattern-616441716 Jun 06 21:11:37.450303 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 370f0df7dc4745edb578a5f922c0f57f Jun 06 21:11:37.450303 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-TestVolumeBootPattern-616441716 Jun 06 21:11:37.450303 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-TestVolumeBootPattern-616441716-project Jun 06 21:11:37.450303 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:11:37.450303 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:11:37.450303 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: 67481128d30049d29d5f0e66b1a4c970 Jun 06 21:11:37.450303 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-TestVolumeBootPattern-616441716-project Jun 06 21:11:37.450303 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: > Jun 06 21:11:37.450303 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Instance 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 could not be found. Jun 06 21:11:37.450303 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '56edbb7a-b8fb-4934-a7f5-9f2cf82542a3'} Jun 06 21:11:37.453788 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:11:37.453788 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:37.453788 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:11:37.453788 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:11:37.453788 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:11:37.453788 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:11:37.453788 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:11:37.453788 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:11:37.453788 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:11:37.453788 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:11:37.453788 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 could not be found. Jun 06 21:11:37.453788 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:37.453788 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:37.453788 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:37.453788 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:37.453788 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:37.453788 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:37.453788 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:11:37.453788 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:11:37.453788 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:11:37.455541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:11:37.455541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:11:37.455541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:11:37.455541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:11:37.455541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:11:37.455541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:11:37.455541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:11:37.455541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 could not be found. Jun 06 21:11:37.455541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:37.455541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:37.455541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:37.455541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:37.455541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:37.455541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:37.455541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:11:37.455541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:11:37.455541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 could not be found. Jun 06 21:11:37.455541 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:37.458842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1a948e3e-11c4-4c1d-b095-fa9ac0b27384 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Returning 404 to user: Instance 56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:11:37.458842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1a948e3e-11c4-4c1d-b095-fa9ac0b27384 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3" status: 404 len: 111 microversion: 2.1 time: 0.066048 Jun 06 21:11:37.458842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 428/816] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:37 2022] GET /compute/v2.1/servers/56edbb7a-b8fb-4934-a7f5-9f2cf82542a3 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 21:11:37.614866 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-f6635b6a-df3d-4914-a1c7-3e7aaa9a455d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:37.645362 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-f6635b6a-df3d-4914-a1c7-3e7aaa9a455d tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1520 microversion: 2.1 time: 0.525153 Jun 06 21:11:37.645963 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 389/817] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:37 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1520 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:11:37.704766 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-680c2faf-3426-43b0-b168-806ad9d9b2de tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:37.705462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-680c2faf-3426-43b0-b168-806ad9d9b2de tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:37.714280 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-680c2faf-3426-43b0-b168-806ad9d9b2de tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:37.725242 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-680c2faf-3426-43b0-b168-806ad9d9b2de tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:37.726239 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-680c2faf-3426-43b0-b168-806ad9d9b2de tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:37.726862 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-680c2faf-3426-43b0-b168-806ad9d9b2de tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:37.986658 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-680c2faf-3426-43b0-b168-806ad9d9b2de tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:38.001645 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-680c2faf-3426-43b0-b168-806ad9d9b2de tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1574 microversion: 2.1 time: 0.302878 Jun 06 21:11:38.002255 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 429/818] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:37 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1574 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:38.322739 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-bdfc03f9-029d-424e-8dae-50b40414a4d0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:38.323365 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-bdfc03f9-029d-424e-8dae-50b40414a4d0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:38.333472 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bdfc03f9-029d-424e-8dae-50b40414a4d0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:38.333905 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bdfc03f9-029d-424e-8dae-50b40414a4d0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:38.334742 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bdfc03f9-029d-424e-8dae-50b40414a4d0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:38.335137 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bdfc03f9-029d-424e-8dae-50b40414a4d0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:38.362232 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-1e17ae68-b3a6-4f99-8af3-77c5d0f5de1c req-1b83cbf0-45aa-4df2-b01d-4773a0c919fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9258ebef-e9e5-47b9-84b9-d02803d028b1", "name": "network-vif-deleted", "tag": "8ea2812d-8bbf-448e-878b-0b84bae40aa1"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:11:38.387837 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-1e17ae68-b3a6-4f99-8af3-77c5d0f5de1c req-1b83cbf0-45aa-4df2-b01d-4773a0c919fb service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:38.388615 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-1e17ae68-b3a6-4f99-8af3-77c5d0f5de1c req-1b83cbf0-45aa-4df2-b01d-4773a0c919fb service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:38.409582 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-1e17ae68-b3a6-4f99-8af3-77c5d0f5de1c req-1b83cbf0-45aa-4df2-b01d-4773a0c919fb service nova] Creating event network-vif-deleted:8ea2812d-8bbf-448e-878b-0b84bae40aa1 for instance 9258ebef-e9e5-47b9-84b9-d02803d028b1 on hv-cinder-84488 Jun 06 21:11:38.415676 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-1e17ae68-b3a6-4f99-8af3-77c5d0f5de1c req-1b83cbf0-45aa-4df2-b01d-4773a0c919fb service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064281 Jun 06 21:11:38.416557 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 430/819] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:11:38.520975 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-bdfc03f9-029d-424e-8dae-50b40414a4d0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:38.530709 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-bdfc03f9-029d-424e-8dae-50b40414a4d0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:38.532279 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-bdfc03f9-029d-424e-8dae-50b40414a4d0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:38.533580 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-bdfc03f9-029d-424e-8dae-50b40414a4d0 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1728 microversion: 2.20 time: 0.215358 Jun 06 21:11:38.534204 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 390/820] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:38 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1728 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 21:11:38.674736 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1cd98198-4037-48a8-ac74-42edbfa2b20a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:38.676269 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1cd98198-4037-48a8-ac74-42edbfa2b20a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:38.685649 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1cd98198-4037-48a8-ac74-42edbfa2b20a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:38.686184 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1cd98198-4037-48a8-ac74-42edbfa2b20a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:38.687050 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1cd98198-4037-48a8-ac74-42edbfa2b20a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:38.687578 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1cd98198-4037-48a8-ac74-42edbfa2b20a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:38.727742 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1cd98198-4037-48a8-ac74-42edbfa2b20a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:38.728890 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1cd98198-4037-48a8-ac74-42edbfa2b20a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:38.728890 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-1cd98198-4037-48a8-ac74-42edbfa2b20a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lazy-loading 'fault' on Instance uuid 9258ebef-e9e5-47b9-84b9-d02803d028b1 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:11:38.732638 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:38.935658 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-6cff52cb-6f0f-4229-82f0-1b2e7d0ca29e req-5c5c92f7-604b-4012-b85c-542478974f16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807baad3-4d23-4d63-b4a9-7163fc77e302", "name": "network-vif-plugged", "status": "completed", "tag": "98717e19-2897-4922-9eb5-8ca664fad7a8"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:11:38.950363 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-6cff52cb-6f0f-4229-82f0-1b2e7d0ca29e req-5c5c92f7-604b-4012-b85c-542478974f16 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:38.951025 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-6cff52cb-6f0f-4229-82f0-1b2e7d0ca29e req-5c5c92f7-604b-4012-b85c-542478974f16 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:38.969912 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-6cff52cb-6f0f-4229-82f0-1b2e7d0ca29e req-5c5c92f7-604b-4012-b85c-542478974f16 service nova] Creating event network-vif-plugged:98717e19-2897-4922-9eb5-8ca664fad7a8 for instance 807baad3-4d23-4d63-b4a9-7163fc77e302 on hv-cinder-84488 Jun 06 21:11:38.975802 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-6cff52cb-6f0f-4229-82f0-1b2e7d0ca29e req-5c5c92f7-604b-4012-b85c-542478974f16 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047145 Jun 06 21:11:38.976717 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 391/821] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:11:39.027909 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0944e80d-b7ce-4aaf-908e-890f60635155 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:39.029106 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-0944e80d-b7ce-4aaf-908e-890f60635155 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:39.038340 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0944e80d-b7ce-4aaf-908e-890f60635155 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:39.038904 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0944e80d-b7ce-4aaf-908e-890f60635155 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:39.039584 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0944e80d-b7ce-4aaf-908e-890f60635155 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:39.040055 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0944e80d-b7ce-4aaf-908e-890f60635155 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:39.042785 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1cd98198-4037-48a8-ac74-42edbfa2b20a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab9da673f40b4e3eb541fdc380cfe282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0246519bc2240cf8d1ba54172c0faca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:39.059196 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1cd98198-4037-48a8-ac74-42edbfa2b20a tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 200 len: 1312 microversion: 2.1 time: 0.392684 Jun 06 21:11:39.063721 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 431/822] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:38 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 1312 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:39.254175 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-0944e80d-b7ce-4aaf-908e-890f60635155 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:39.263123 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c67b5b80-814c-456a-b638-55c1e703a7d5 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] Calling method '.version_select at 0x7f272565d4c0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:39.271372 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-0944e80d-b7ce-4aaf-908e-890f60635155 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1574 microversion: 2.1 time: 0.248036 Jun 06 21:11:39.273343 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 392/823] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:39 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1574 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:39.301002 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c67b5b80-814c-456a-b638-55c1e703a7d5 tempest-TestVolumeBootPattern-616441716 tempest-TestVolumeBootPattern-616441716-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1736120711" status: 202 len: 0 microversion: 2.1 time: 0.043485 Jun 06 21:11:39.302542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 432/824] 10.222.0.33 () {58 vars in 1262 bytes} [Mon Jun 6 21:11:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1736120711 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 21:11:39.559890 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-5891e789-6bd4-433b-8b0d-6825ed8b7022 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:39.567475 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-5891e789-6bd4-433b-8b0d-6825ed8b7022 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:39.581519 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5891e789-6bd4-433b-8b0d-6825ed8b7022 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:39.582812 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5891e789-6bd4-433b-8b0d-6825ed8b7022 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:39.584903 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5891e789-6bd4-433b-8b0d-6825ed8b7022 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:39.585817 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5891e789-6bd4-433b-8b0d-6825ed8b7022 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:39.908037 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-5891e789-6bd4-433b-8b0d-6825ed8b7022 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:39.926271 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-5891e789-6bd4-433b-8b0d-6825ed8b7022 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:39.929491 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-5891e789-6bd4-433b-8b0d-6825ed8b7022 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:39.932762 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-5891e789-6bd4-433b-8b0d-6825ed8b7022 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1728 microversion: 2.20 time: 0.380085 Jun 06 21:11:39.933853 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 393/825] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:39 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1728 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:11:40.083431 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-efb46fde-8bed-4c4f-8f45-7cd625070681 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:40.084182 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-efb46fde-8bed-4c4f-8f45-7cd625070681 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] [instance: 9258ebef-e9e5-47b9-84b9-d02803d028b1] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:40.091593 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-efb46fde-8bed-4c4f-8f45-7cd625070681 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:40.092125 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-efb46fde-8bed-4c4f-8f45-7cd625070681 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:40.093062 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-efb46fde-8bed-4c4f-8f45-7cd625070681 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:40.093585 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-efb46fde-8bed-4c4f-8f45-7cd625070681 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:40.111499 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-efb46fde-8bed-4c4f-8f45-7cd625070681 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] HTTP exception thrown: Instance 9258ebef-e9e5-47b9-84b9-d02803d028b1 could not be found. Jun 06 21:11:40.113542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-efb46fde-8bed-4c4f-8f45-7cd625070681 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Request method failure captured: Jun 06 21:11:40.113542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 HTTP/1.1 Jun 06 21:11:40.113542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:11:40.113542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:11:40.113542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:11:40.113542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:11:40.113542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:11:40.113542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:11:40.113542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:11:40.113542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:11:40.113542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinmw5kgLR6NMd10ofnxehsGJrZH5eihmOg4VV2rlqBjZwvfhUx8kow_T1NaOr6zNm6K1jJsuYEhS0J5QDngP2LhFXAmzwJ6InRv6t8Nhyq76ejvBrCHdAnd0U1eHtmfrOhv9AMEP1mJ0K9M-NNm9AUbkBVRKPRAi4NyD11SlCUna2Q5g Jun 06 21:11:40.113542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:11:40.113542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:11:40.113542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:11:40.113542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:11:40.113542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:11:40.113542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:11:40.113542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: f0246519bc2240cf8d1ba54172c0faca Jun 06 21:11:40.113542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-615855304 Jun 06 21:11:40.113542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:11:40.113542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:11:40.116048 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0246519bc2240cf8d1ba54172c0faca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f0246519bc2240cf8d1ba54172c0faca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f0246519bc2240cf8d1ba54172c0faca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f0246519bc2240cf8d1ba54172c0faca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:11:40.116048 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-ServerRescueNegativeTestJSON-615855304 Jun 06 21:11:40.116048 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: f0246519bc2240cf8d1ba54172c0faca Jun 06 21:11:40.116048 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-615855304 Jun 06 21:11:40.116048 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-ServerRescueNegativeTestJSON-615855304-project Jun 06 21:11:40.116048 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:11:40.116048 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:11:40.116048 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: ab9da673f40b4e3eb541fdc380cfe282 Jun 06 21:11:40.116048 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-ServerRescueNegativeTestJSON-615855304-project Jun 06 21:11:40.116048 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: > Jun 06 21:11:40.116048 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Instance 9258ebef-e9e5-47b9-84b9-d02803d028b1 could not be found. Jun 06 21:11:40.116048 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '9258ebef-e9e5-47b9-84b9-d02803d028b1'} Jun 06 21:11:40.117440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:11:40.117440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:40.117440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:11:40.117440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:11:40.117440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:11:40.117440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:11:40.117440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:11:40.117440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:11:40.117440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:11:40.117440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:11:40.117440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9258ebef-e9e5-47b9-84b9-d02803d028b1 could not be found. Jun 06 21:11:40.117440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:40.117440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:40.117440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:40.117440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:40.117440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:40.117440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:40.117440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:11:40.117440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:11:40.117440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:11:40.119857 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:11:40.119857 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:11:40.119857 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:11:40.119857 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:11:40.119857 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:11:40.119857 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:11:40.119857 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:11:40.119857 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9258ebef-e9e5-47b9-84b9-d02803d028b1 could not be found. Jun 06 21:11:40.119857 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:40.119857 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:40.119857 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:40.119857 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:40.119857 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:40.119857 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:40.119857 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:11:40.119857 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:11:40.119857 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9258ebef-e9e5-47b9-84b9-d02803d028b1 could not be found. Jun 06 21:11:40.119857 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:40.121844 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-efb46fde-8bed-4c4f-8f45-7cd625070681 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] Returning 404 to user: Instance 9258ebef-e9e5-47b9-84b9-d02803d028b1 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:11:40.121844 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-efb46fde-8bed-4c4f-8f45-7cd625070681 tempest-ServerRescueNegativeTestJSON-615855304 tempest-ServerRescueNegativeTestJSON-615855304-project] 10.222.0.33 "GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1" status: 404 len: 111 microversion: 2.1 time: 0.037392 Jun 06 21:11:40.121844 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 433/826] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:40 2022] GET /compute/v2.1/servers/9258ebef-e9e5-47b9-84b9-d02803d028b1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:11:40.293815 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-08ceaffe-e5c2-4215-8fa3-2081f0f0cb32 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:40.294617 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-08ceaffe-e5c2-4215-8fa3-2081f0f0cb32 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:40.303935 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-08ceaffe-e5c2-4215-8fa3-2081f0f0cb32 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:40.304740 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-08ceaffe-e5c2-4215-8fa3-2081f0f0cb32 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:40.306080 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-08ceaffe-e5c2-4215-8fa3-2081f0f0cb32 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:40.306565 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-08ceaffe-e5c2-4215-8fa3-2081f0f0cb32 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:40.312772 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:40.645396 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-08ceaffe-e5c2-4215-8fa3-2081f0f0cb32 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:40.661087 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-08ceaffe-e5c2-4215-8fa3-2081f0f0cb32 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1574 microversion: 2.1 time: 0.372799 Jun 06 21:11:40.663942 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 394/827] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:40 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1574 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:11:40.952978 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-25d2cde0-c085-453b-87a1-f9f141cb3b70 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:40.954300 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-25d2cde0-c085-453b-87a1-f9f141cb3b70 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:40.964435 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-25d2cde0-c085-453b-87a1-f9f141cb3b70 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:40.965557 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-25d2cde0-c085-453b-87a1-f9f141cb3b70 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:40.966781 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-25d2cde0-c085-453b-87a1-f9f141cb3b70 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:40.967618 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-25d2cde0-c085-453b-87a1-f9f141cb3b70 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:41.012478 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-271b59a4-9c76-4b29-9757-5761a47c5662 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:41.013596 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-271b59a4-9c76-4b29-9757-5761a47c5662 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:41.023092 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-271b59a4-9c76-4b29-9757-5761a47c5662 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:41.023953 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-271b59a4-9c76-4b29-9757-5761a47c5662 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:41.025429 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-271b59a4-9c76-4b29-9757-5761a47c5662 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:41.026349 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-271b59a4-9c76-4b29-9757-5761a47c5662 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:41.166123 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.objects.instance [None req-271b59a4-9c76-4b29-9757-5761a47c5662 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lazy-loading 'services' on Instance uuid 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab {{(pid=117860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:11:41.249556 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-25d2cde0-c085-453b-87a1-f9f141cb3b70 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:41.259942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-25d2cde0-c085-453b-87a1-f9f141cb3b70 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:41.262012 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-25d2cde0-c085-453b-87a1-f9f141cb3b70 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:41.268324 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-25d2cde0-c085-453b-87a1-f9f141cb3b70 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1715 microversion: 2.20 time: 0.319596 Jun 06 21:11:41.268324 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 434/828] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:11:40 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1715 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:11:41.316086 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-271b59a4-9c76-4b29-9757-5761a47c5662 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab/os-volume_attachments/a855014e-b7b2-4c21-b78f-aa85e7885a94" status: 202 len: 0 microversion: 2.1 time: 0.308027 Jun 06 21:11:41.321608 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 395/829] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 6 21:11:41 2022] DELETE /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab/os-volume_attachments/a855014e-b7b2-4c21-b78f-aa85e7885a94 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:11:41.333842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-77ce6881-260a-404f-905e-224610b0a7ed tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:41.334917 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-77ce6881-260a-404f-905e-224610b0a7ed tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:41.347226 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-77ce6881-260a-404f-905e-224610b0a7ed tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:41.348263 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-77ce6881-260a-404f-905e-224610b0a7ed tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:41.349780 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-77ce6881-260a-404f-905e-224610b0a7ed tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:41.350525 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-77ce6881-260a-404f-905e-224610b0a7ed tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:41.405161 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-77ce6881-260a-404f-905e-224610b0a7ed tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077356 Jun 06 21:11:41.407147 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 435/830] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 6 21:11:41 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:11:41.690198 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-130b5651-c091-46d0-88f1-63e4d4160524 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:41.691652 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-130b5651-c091-46d0-88f1-63e4d4160524 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:41.699373 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-130b5651-c091-46d0-88f1-63e4d4160524 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:41.699811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-130b5651-c091-46d0-88f1-63e4d4160524 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:41.700646 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-130b5651-c091-46d0-88f1-63e4d4160524 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:41.701296 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-130b5651-c091-46d0-88f1-63e4d4160524 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:41.969605 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-130b5651-c091-46d0-88f1-63e4d4160524 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:41.978685 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-130b5651-c091-46d0-88f1-63e4d4160524 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1561 microversion: 2.1 time: 0.295119 Jun 06 21:11:41.983661 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 396/831] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:41 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1561 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:42.422624 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2a5582a9-c547-47be-8375-f1a58175b7ff tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:42.424836 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2a5582a9-c547-47be-8375-f1a58175b7ff tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:42.435141 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a5582a9-c547-47be-8375-f1a58175b7ff tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:42.436172 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a5582a9-c547-47be-8375-f1a58175b7ff tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:42.437712 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a5582a9-c547-47be-8375-f1a58175b7ff tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:42.439560 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2a5582a9-c547-47be-8375-f1a58175b7ff tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:42.544098 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2a5582a9-c547-47be-8375-f1a58175b7ff tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127199 Jun 06 21:11:42.552239 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 436/832] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 6 21:11:42 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab/os-volume_attachments => generated 197 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:11:43.563759 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-5c7bba3a-73a1-4c1f-b7c1-b432bddd6403 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:43.566334 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-5c7bba3a-73a1-4c1f-b7c1-b432bddd6403 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:43.579097 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5c7bba3a-73a1-4c1f-b7c1-b432bddd6403 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:43.579884 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5c7bba3a-73a1-4c1f-b7c1-b432bddd6403 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:43.581817 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5c7bba3a-73a1-4c1f-b7c1-b432bddd6403 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:43.583320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5c7bba3a-73a1-4c1f-b7c1-b432bddd6403 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:43.671678 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-5c7bba3a-73a1-4c1f-b7c1-b432bddd6403 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.115475 Jun 06 21:11:43.672726 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 397/833] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 6 21:11:43 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab/os-volume_attachments => generated 25 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 21:11:43.790808 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-95eb0fb4-0cf1-4092-8d93-2a1b0d46121c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:43.792058 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-95eb0fb4-0cf1-4092-8d93-2a1b0d46121c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:43.800936 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-95eb0fb4-0cf1-4092-8d93-2a1b0d46121c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:43.801793 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-95eb0fb4-0cf1-4092-8d93-2a1b0d46121c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:43.802916 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-95eb0fb4-0cf1-4092-8d93-2a1b0d46121c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:43.803672 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-95eb0fb4-0cf1-4092-8d93-2a1b0d46121c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:43.850564 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-95eb0fb4-0cf1-4092-8d93-2a1b0d46121c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 21:11:44.030320 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-95eb0fb4-0cf1-4092-8d93-2a1b0d46121c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab" status: 204 len: 0 microversion: 2.1 time: 0.246906 Jun 06 21:11:44.032194 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 437/834] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:11:43 2022] DELETE /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 06 21:11:44.043673 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-7850a5c9-060c-4fe8-a8dc-293b7d48491c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:44.045198 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-7850a5c9-060c-4fe8-a8dc-293b7d48491c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:44.053937 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7850a5c9-060c-4fe8-a8dc-293b7d48491c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:44.059216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7850a5c9-060c-4fe8-a8dc-293b7d48491c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:44.060652 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7850a5c9-060c-4fe8-a8dc-293b7d48491c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:44.063415 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7850a5c9-060c-4fe8-a8dc-293b7d48491c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:44.352873 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-7850a5c9-060c-4fe8-a8dc-293b7d48491c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:44.361135 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-7850a5c9-060c-4fe8-a8dc-293b7d48491c tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab" status: 200 len: 1681 microversion: 2.1 time: 0.322183 Jun 06 21:11:44.361736 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 398/835] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:44 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab => generated 1681 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:45.381545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-053f8981-98bc-4869-98fa-57e5d405dfe3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:45.382351 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-053f8981-98bc-4869-98fa-57e5d405dfe3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:45.397415 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-053f8981-98bc-4869-98fa-57e5d405dfe3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:45.397871 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-053f8981-98bc-4869-98fa-57e5d405dfe3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:45.398661 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-053f8981-98bc-4869-98fa-57e5d405dfe3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:45.403348 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-053f8981-98bc-4869-98fa-57e5d405dfe3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:45.757985 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-053f8981-98bc-4869-98fa-57e5d405dfe3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:45.785685 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-053f8981-98bc-4869-98fa-57e5d405dfe3 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab" status: 200 len: 1681 microversion: 2.1 time: 0.408204 Jun 06 21:11:45.786678 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 438/836] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:45 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab => generated 1681 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:46.805649 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-8224ca9a-ce1a-45f6-8310-77b900f9f378 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:46.806350 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-8224ca9a-ce1a-45f6-8310-77b900f9f378 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:46.822941 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8224ca9a-ce1a-45f6-8310-77b900f9f378 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:46.824862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8224ca9a-ce1a-45f6-8310-77b900f9f378 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:46.827400 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8224ca9a-ce1a-45f6-8310-77b900f9f378 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:46.828292 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8224ca9a-ce1a-45f6-8310-77b900f9f378 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:46.969698 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-c0f473dd-799c-4295-a13b-c0c4a7d06a84 req-9612cc04-3016-4310-86d3-f66cf60cf7b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab", "name": "network-vif-deleted", "tag": "15c41403-c077-4ee6-a769-5c89f46790c6"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:11:47.031670 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-c0f473dd-799c-4295-a13b-c0c4a7d06a84 req-9612cc04-3016-4310-86d3-f66cf60cf7b2 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:47.033005 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-c0f473dd-799c-4295-a13b-c0c4a7d06a84 req-9612cc04-3016-4310-86d3-f66cf60cf7b2 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:47.034483 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-8224ca9a-ce1a-45f6-8310-77b900f9f378 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8713cb23a93147f8b52f88e240c81d6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a771f1ab27f40aca2d546901cdcecda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:47.051592 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-8224ca9a-ce1a-45f6-8310-77b900f9f378 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab" status: 200 len: 1614 microversion: 2.1 time: 0.250485 Jun 06 21:11:47.053351 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 399/837] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:46 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab => generated 1614 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:11:47.109947 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-c0f473dd-799c-4295-a13b-c0c4a7d06a84 req-9612cc04-3016-4310-86d3-f66cf60cf7b2 service nova] Creating event network-vif-deleted:15c41403-c077-4ee6-a769-5c89f46790c6 for instance 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab on hv-cinder-84488 Jun 06 21:11:47.119039 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-c0f473dd-799c-4295-a13b-c0c4a7d06a84 req-9612cc04-3016-4310-86d3-f66cf60cf7b2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157855 Jun 06 21:11:47.120336 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 439/838] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:11:48.081570 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-efb32804-8d1a-4504-ac3c-735e49f2a962 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:48.082188 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-efb32804-8d1a-4504-ac3c-735e49f2a962 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:48.089046 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-efb32804-8d1a-4504-ac3c-735e49f2a962 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:48.089766 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-efb32804-8d1a-4504-ac3c-735e49f2a962 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:48.090565 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-efb32804-8d1a-4504-ac3c-735e49f2a962 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:48.091186 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-efb32804-8d1a-4504-ac3c-735e49f2a962 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:48.106663 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-efb32804-8d1a-4504-ac3c-735e49f2a962 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] HTTP exception thrown: Instance 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab could not be found. Jun 06 21:11:48.108457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-efb32804-8d1a-4504-ac3c-735e49f2a962 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Request method failure captured: Jun 06 21:11:48.108457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab HTTP/1.1 Jun 06 21:11:48.108457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:11:48.108457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:11:48.108457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:11:48.108457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 0 Jun 06 21:11:48.108457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:11:48.108457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:11:48.108457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:11:48.108457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:11:48.108457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinmvxW1bVEWZVhCRlgeG6PDmaOvHpznA6mf68h7fAFngISNh4GnD9XFqvo52ymtA4PTaTSN-lCxDTYk7dFVIPU5elkSuX6Hf8rm-_SR1iR7N3wUEkc6KR6wmwlcMFMA3l3v8mmff7I1soQTiyS_qgppqz32gWX7gOKmiYav_WF1YU4TA Jun 06 21:11:48.108457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:11:48.108457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:11:48.108457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:11:48.108457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:11:48.108457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:11:48.108457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:11:48.108457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:11:48.108457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:48.108457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:11:48.108457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:11:48.109992 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:11:48.109992 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:48.109992 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:11:48.109992 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:48.109992 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:11:48.109992 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:11:48.109992 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:11:48.109992 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: 8713cb23a93147f8b52f88e240c81d6f Jun 06 21:11:48.109992 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:11:48.109992 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: > Jun 06 21:11:48.109992 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Instance 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab could not be found. Jun 06 21:11:48.109992 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'id': '6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab'} Jun 06 21:11:48.110747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:11:48.110747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:48.110747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:11:48.110747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:11:48.110747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:11:48.110747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:11:48.110747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:11:48.110747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:11:48.110747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:11:48.110747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:11:48.110747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab could not be found. Jun 06 21:11:48.110747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:48.110747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:48.110747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:48.110747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:48.110747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:48.110747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:48.110747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:11:48.110747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:11:48.110747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:11:48.111982 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:11:48.111982 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:11:48.111982 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:11:48.111982 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:11:48.111982 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:11:48.111982 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:11:48.111982 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:11:48.111982 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab could not be found. Jun 06 21:11:48.111982 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:48.111982 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:48.111982 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:48.111982 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:48.111982 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:48.111982 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:48.111982 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:11:48.111982 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:11:48.111982 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab could not be found. Jun 06 21:11:48.111982 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:48.114735 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-efb32804-8d1a-4504-ac3c-735e49f2a962 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Returning 404 to user: Instance 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab could not be found. {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:11:48.115923 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-efb32804-8d1a-4504-ac3c-735e49f2a962 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab" status: 404 len: 111 microversion: 2.1 time: 0.038788 Jun 06 21:11:48.116747 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 400/839] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:48 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 21:11:48.134704 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-792a6db5-58c5-4c61-a274-5572bce8698e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '.version_select at 0x7f272562b280>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:48.174139 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-792a6db5-58c5-4c61-a274-5572bce8698e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1466420993" status: 202 len: 0 microversion: 2.1 time: 0.049198 Jun 06 21:11:48.182690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 440/840] 10.222.0.33 () {58 vars in 1220 bytes} [Mon Jun 6 21:11:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1466420993 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:11:51.243394 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0ababa53-49ce-4fbe-918e-e5dc2e03b95e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:51.244154 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-0ababa53-49ce-4fbe-918e-e5dc2e03b95e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:51.261562 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0ababa53-49ce-4fbe-918e-e5dc2e03b95e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:51.262050 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0ababa53-49ce-4fbe-918e-e5dc2e03b95e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:51.262839 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0ababa53-49ce-4fbe-918e-e5dc2e03b95e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:51.263279 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0ababa53-49ce-4fbe-918e-e5dc2e03b95e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:51.310674 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-0ababa53-49ce-4fbe-918e-e5dc2e03b95e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] HTTP exception thrown: Instance 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab could not be found. Jun 06 21:11:51.313354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0ababa53-49ce-4fbe-918e-e5dc2e03b95e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Request method failure captured: Jun 06 21:11:51.313354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: DELETE /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab HTTP/1.1 Jun 06 21:11:51.313354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:11:51.313354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:11:51.313354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:11:51.313354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 0 Jun 06 21:11:51.313354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:11:51.313354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:11:51.313354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:11:51.313354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:11:51.313354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinmvxW1bVEWZVhCRlgeG6PDmaOvHpznA6mf68h7fAFngISNh4GnD9XFqvo52ymtA4PTaTSN-lCxDTYk7dFVIPU5elkSuX6Hf8rm-_SR1iR7N3wUEkc6KR6wmwlcMFMA3l3v8mmff7I1soQTiyS_qgppqz32gWX7gOKmiYav_WF1YU4TA Jun 06 21:11:51.313354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:11:51.313354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:11:51.313354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:11:51.313354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:11:51.313354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:11:51.313354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:11:51.313354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:11:51.313354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:51.313354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:11:51.313354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:11:51.315833 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:11:51.315833 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:51.315833 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:11:51.315833 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:51.315833 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:11:51.315833 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:11:51.315833 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:11:51.315833 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: 8713cb23a93147f8b52f88e240c81d6f Jun 06 21:11:51.315833 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:11:51.315833 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: > Jun 06 21:11:51.315833 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Instance 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab could not be found. Jun 06 21:11:51.315833 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'id': '6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab'} Jun 06 21:11:51.317098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:11:51.317098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:51.317098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:11:51.317098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:11:51.317098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:11:51.317098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:11:51.317098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:11:51.317098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:11:51.317098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:11:51.317098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:11:51.317098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab could not be found. Jun 06 21:11:51.317098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:51.317098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:51.317098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:51.317098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:51.317098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:51.317098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:51.317098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:11:51.317098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:11:51.317098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:11:51.318588 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:11:51.318588 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 21:11:51.318588 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 21:11:51.318588 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 21:11:51.318588 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 21:11:51.318588 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:11:51.318588 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:11:51.318588 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:11:51.318588 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:11:51.318588 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab could not be found. Jun 06 21:11:51.318588 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:51.318588 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:51.318588 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:51.318588 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:51.318588 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:51.318588 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:51.318588 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:11:51.318588 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:11:51.318588 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab could not be found. Jun 06 21:11:51.318588 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:51.320676 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0ababa53-49ce-4fbe-918e-e5dc2e03b95e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Returning 404 to user: Instance 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab could not be found. {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:11:51.321883 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-0ababa53-49ce-4fbe-918e-e5dc2e03b95e tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "DELETE /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab" status: 404 len: 111 microversion: 2.1 time: 0.082636 Jun 06 21:11:51.322830 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 401/841] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:11:51 2022] DELETE /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:11:51.336071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-415e717e-e84e-4ef2-bb02-af85a4b5f666 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:51.338089 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-415e717e-e84e-4ef2-bb02-af85a4b5f666 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:51.345033 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-415e717e-e84e-4ef2-bb02-af85a4b5f666 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:51.345684 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-415e717e-e84e-4ef2-bb02-af85a4b5f666 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:51.346751 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-415e717e-e84e-4ef2-bb02-af85a4b5f666 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:51.347489 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-415e717e-e84e-4ef2-bb02-af85a4b5f666 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:51.397266 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-415e717e-e84e-4ef2-bb02-af85a4b5f666 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] HTTP exception thrown: Instance 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab could not be found. Jun 06 21:11:51.402770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-415e717e-e84e-4ef2-bb02-af85a4b5f666 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Request method failure captured: Jun 06 21:11:51.402770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab HTTP/1.1 Jun 06 21:11:51.402770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:11:51.402770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:11:51.402770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:11:51.402770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:11:51.402770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:11:51.402770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:11:51.402770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:11:51.402770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:11:51.402770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinmvxW1bVEWZVhCRlgeG6PDmaOvHpznA6mf68h7fAFngISNh4GnD9XFqvo52ymtA4PTaTSN-lCxDTYk7dFVIPU5elkSuX6Hf8rm-_SR1iR7N3wUEkc6KR6wmwlcMFMA3l3v8mmff7I1soQTiyS_qgppqz32gWX7gOKmiYav_WF1YU4TA Jun 06 21:11:51.402770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:11:51.402770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:11:51.402770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:11:51.402770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:11:51.402770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:11:51.402770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:11:51.402770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:11:51.402770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:51.402770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:11:51.402770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:11:51.405740 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:11:51.405740 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:51.405740 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:11:51.405740 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:51.405740 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:11:51.405740 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:11:51.405740 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:11:51.405740 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: 8713cb23a93147f8b52f88e240c81d6f Jun 06 21:11:51.405740 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:11:51.405740 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: > Jun 06 21:11:51.405740 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Instance 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab could not be found. Jun 06 21:11:51.405740 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab'} Jun 06 21:11:51.407023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:11:51.407023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:51.407023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:11:51.407023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:11:51.407023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:11:51.407023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:11:51.407023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:11:51.407023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:11:51.407023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:11:51.407023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:11:51.407023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab could not be found. Jun 06 21:11:51.407023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:51.407023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:51.407023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:51.407023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:51.407023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:51.407023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:51.407023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:11:51.407023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:11:51.407023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:11:51.409569 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:11:51.409569 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:11:51.409569 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:11:51.409569 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:11:51.409569 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:11:51.409569 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:11:51.409569 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:11:51.409569 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab could not be found. Jun 06 21:11:51.409569 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:51.409569 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:51.409569 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:51.409569 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:51.409569 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:51.409569 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:51.409569 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:11:51.409569 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:11:51.409569 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab could not be found. Jun 06 21:11:51.409569 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:51.411743 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-415e717e-e84e-4ef2-bb02-af85a4b5f666 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Returning 404 to user: Instance 6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:11:51.411743 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-415e717e-e84e-4ef2-bb02-af85a4b5f666 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab" status: 404 len: 111 microversion: 2.1 time: 0.076537 Jun 06 21:11:51.411743 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 441/842] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:51 2022] GET /compute/v2.1/servers/6a9d0c5c-6dd7-42ba-8ee4-75f84d1405ab => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:11:52.714223 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-a09d87cc-c174-411a-a3ee-04b5aa553510 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:52.715616 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-a09d87cc-c174-411a-a3ee-04b5aa553510 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:52.727780 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a09d87cc-c174-411a-a3ee-04b5aa553510 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:52.728735 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a09d87cc-c174-411a-a3ee-04b5aa553510 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:52.729994 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a09d87cc-c174-411a-a3ee-04b5aa553510 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:52.730847 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a09d87cc-c174-411a-a3ee-04b5aa553510 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:52.759417 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-a09d87cc-c174-411a-a3ee-04b5aa553510 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] HTTP exception thrown: Instance 9fe2313a-d12a-432f-b5b2-4f410f89682d could not be found. Jun 06 21:11:52.764785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-a09d87cc-c174-411a-a3ee-04b5aa553510 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Request method failure captured: Jun 06 21:11:52.764785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: DELETE /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d HTTP/1.1 Jun 06 21:11:52.764785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:11:52.764785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:11:52.764785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:11:52.764785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 0 Jun 06 21:11:52.764785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:11:52.764785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:11:52.764785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:11:52.764785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:11:52.764785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinmvxW1bVEWZVhCRlgeG6PDmaOvHpznA6mf68h7fAFngISNh4GnD9XFqvo52ymtA4PTaTSN-lCxDTYk7dFVIPU5elkSuX6Hf8rm-_SR1iR7N3wUEkc6KR6wmwlcMFMA3l3v8mmff7I1soQTiyS_qgppqz32gWX7gOKmiYav_WF1YU4TA Jun 06 21:11:52.764785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:11:52.764785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:11:52.764785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:11:52.764785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:11:52.764785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:11:52.764785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:11:52.764785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:11:52.764785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:52.764785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:11:52.764785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:11:52.767425 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:11:52.767425 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:52.767425 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:11:52.767425 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:52.767425 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:11:52.767425 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:11:52.767425 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:11:52.767425 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: 8713cb23a93147f8b52f88e240c81d6f Jun 06 21:11:52.767425 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:11:52.767425 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: > Jun 06 21:11:52.767425 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Instance 9fe2313a-d12a-432f-b5b2-4f410f89682d could not be found. Jun 06 21:11:52.767425 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'id': '9fe2313a-d12a-432f-b5b2-4f410f89682d'} Jun 06 21:11:52.768863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:11:52.768863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:52.768863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:11:52.768863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:11:52.768863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:11:52.768863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:11:52.768863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:11:52.768863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:11:52.768863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:11:52.768863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:11:52.768863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fe2313a-d12a-432f-b5b2-4f410f89682d could not be found. Jun 06 21:11:52.768863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:52.768863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:52.768863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:52.768863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:52.768863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:52.768863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:52.768863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:11:52.768863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:11:52.768863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:11:52.774855 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:11:52.774855 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 21:11:52.774855 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 21:11:52.774855 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 21:11:52.774855 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 21:11:52.774855 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:11:52.774855 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:11:52.774855 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:11:52.774855 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:11:52.774855 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fe2313a-d12a-432f-b5b2-4f410f89682d could not be found. Jun 06 21:11:52.774855 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:52.774855 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:52.774855 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:52.774855 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:52.774855 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:52.774855 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:52.774855 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:11:52.774855 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:11:52.774855 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fe2313a-d12a-432f-b5b2-4f410f89682d could not be found. Jun 06 21:11:52.774855 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:52.783620 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-a09d87cc-c174-411a-a3ee-04b5aa553510 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Returning 404 to user: Instance 9fe2313a-d12a-432f-b5b2-4f410f89682d could not be found. {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:11:52.783620 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-a09d87cc-c174-411a-a3ee-04b5aa553510 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "DELETE /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d" status: 404 len: 111 microversion: 2.1 time: 0.075360 Jun 06 21:11:52.790414 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 402/843] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:11:52 2022] DELETE /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:11:52.797494 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2cc392b6-5002-4716-b567-6b5c4b513561 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:52.798193 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2cc392b6-5002-4716-b567-6b5c4b513561 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 9fe2313a-d12a-432f-b5b2-4f410f89682d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:52.806891 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2cc392b6-5002-4716-b567-6b5c4b513561 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:52.807344 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2cc392b6-5002-4716-b567-6b5c4b513561 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:52.808394 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2cc392b6-5002-4716-b567-6b5c4b513561 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:52.809808 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2cc392b6-5002-4716-b567-6b5c4b513561 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:52.827746 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-2cc392b6-5002-4716-b567-6b5c4b513561 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] HTTP exception thrown: Instance 9fe2313a-d12a-432f-b5b2-4f410f89682d could not be found. Jun 06 21:11:52.829905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2cc392b6-5002-4716-b567-6b5c4b513561 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Request method failure captured: Jun 06 21:11:52.829905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d HTTP/1.1 Jun 06 21:11:52.829905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:11:52.829905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:11:52.829905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:11:52.829905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:11:52.829905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:11:52.829905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:11:52.829905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:11:52.829905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:11:52.829905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinmvxW1bVEWZVhCRlgeG6PDmaOvHpznA6mf68h7fAFngISNh4GnD9XFqvo52ymtA4PTaTSN-lCxDTYk7dFVIPU5elkSuX6Hf8rm-_SR1iR7N3wUEkc6KR6wmwlcMFMA3l3v8mmff7I1soQTiyS_qgppqz32gWX7gOKmiYav_WF1YU4TA Jun 06 21:11:52.829905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:11:52.829905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:11:52.829905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:11:52.829905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:11:52.829905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:11:52.829905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:11:52.829905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:11:52.829905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:52.829905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:11:52.829905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:11:52.831957 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:11:52.831957 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:52.831957 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:11:52.831957 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:52.831957 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:11:52.831957 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:11:52.831957 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:11:52.831957 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: 8713cb23a93147f8b52f88e240c81d6f Jun 06 21:11:52.831957 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:11:52.831957 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: > Jun 06 21:11:52.831957 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Instance 9fe2313a-d12a-432f-b5b2-4f410f89682d could not be found. Jun 06 21:11:52.831957 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '9fe2313a-d12a-432f-b5b2-4f410f89682d'} Jun 06 21:11:52.832747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:11:52.832747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:52.832747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:11:52.832747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:11:52.832747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:11:52.832747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:11:52.832747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:11:52.832747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:11:52.832747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:11:52.832747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:11:52.832747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9fe2313a-d12a-432f-b5b2-4f410f89682d could not be found. Jun 06 21:11:52.832747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:52.832747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:52.832747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:52.832747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:52.832747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:52.832747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:52.832747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:11:52.832747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:11:52.832747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:11:52.833953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:11:52.833953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:11:52.833953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:11:52.833953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:11:52.833953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:11:52.833953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:11:52.833953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:11:52.833953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9fe2313a-d12a-432f-b5b2-4f410f89682d could not be found. Jun 06 21:11:52.833953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:52.833953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:52.833953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:52.833953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:52.833953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:52.833953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:52.833953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:11:52.833953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:11:52.833953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9fe2313a-d12a-432f-b5b2-4f410f89682d could not be found. Jun 06 21:11:52.833953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:52.837523 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2cc392b6-5002-4716-b567-6b5c4b513561 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Returning 404 to user: Instance 9fe2313a-d12a-432f-b5b2-4f410f89682d could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:11:52.839885 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2cc392b6-5002-4716-b567-6b5c4b513561 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d" status: 404 len: 111 microversion: 2.1 time: 0.047356 Jun 06 21:11:52.857522 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 442/844] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:52 2022] GET /compute/v2.1/servers/9fe2313a-d12a-432f-b5b2-4f410f89682d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:11:52.873930 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-7f29d813-008c-4908-8488-0f68506225f6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:52.876428 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-7f29d813-008c-4908-8488-0f68506225f6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:52.900167 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7f29d813-008c-4908-8488-0f68506225f6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:52.900993 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7f29d813-008c-4908-8488-0f68506225f6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:52.903897 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7f29d813-008c-4908-8488-0f68506225f6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:52.904523 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7f29d813-008c-4908-8488-0f68506225f6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:52.932249 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-7f29d813-008c-4908-8488-0f68506225f6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] HTTP exception thrown: Instance 8a6a1d28-5f70-418f-8991-139855579e13 could not be found. Jun 06 21:11:52.934497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-7f29d813-008c-4908-8488-0f68506225f6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Request method failure captured: Jun 06 21:11:52.934497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: DELETE /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 HTTP/1.1 Jun 06 21:11:52.934497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:11:52.934497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:11:52.934497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:11:52.934497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 0 Jun 06 21:11:52.934497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:11:52.934497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:11:52.934497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:11:52.934497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:11:52.934497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinmvxW1bVEWZVhCRlgeG6PDmaOvHpznA6mf68h7fAFngISNh4GnD9XFqvo52ymtA4PTaTSN-lCxDTYk7dFVIPU5elkSuX6Hf8rm-_SR1iR7N3wUEkc6KR6wmwlcMFMA3l3v8mmff7I1soQTiyS_qgppqz32gWX7gOKmiYav_WF1YU4TA Jun 06 21:11:52.934497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:11:52.934497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:11:52.934497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:11:52.934497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:11:52.934497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:11:52.934497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:11:52.934497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:11:52.934497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:52.934497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:11:52.934497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:11:52.936473 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:11:52.936473 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:52.936473 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:11:52.936473 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:52.936473 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:11:52.936473 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:11:52.936473 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:11:52.936473 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: 8713cb23a93147f8b52f88e240c81d6f Jun 06 21:11:52.936473 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:11:52.936473 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: > Jun 06 21:11:52.936473 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Instance 8a6a1d28-5f70-418f-8991-139855579e13 could not be found. Jun 06 21:11:52.936473 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'id': '8a6a1d28-5f70-418f-8991-139855579e13'} Jun 06 21:11:52.937720 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:11:52.937720 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:52.937720 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:11:52.937720 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:11:52.937720 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:11:52.937720 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:11:52.937720 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:11:52.937720 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:11:52.937720 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:11:52.937720 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:11:52.937720 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a6a1d28-5f70-418f-8991-139855579e13 could not be found. Jun 06 21:11:52.937720 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:52.937720 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:52.937720 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:52.937720 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:52.937720 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:52.937720 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:52.937720 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:11:52.937720 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:11:52.937720 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:11:52.939882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:11:52.939882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 21:11:52.939882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 21:11:52.939882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 21:11:52.939882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 21:11:52.939882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:11:52.939882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:11:52.939882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:11:52.939882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:11:52.939882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a6a1d28-5f70-418f-8991-139855579e13 could not be found. Jun 06 21:11:52.939882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:52.939882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:52.939882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:52.939882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:52.939882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:52.939882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:52.939882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:11:52.939882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:11:52.939882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a6a1d28-5f70-418f-8991-139855579e13 could not be found. Jun 06 21:11:52.939882 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:52.944666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-7f29d813-008c-4908-8488-0f68506225f6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Returning 404 to user: Instance 8a6a1d28-5f70-418f-8991-139855579e13 could not be found. {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:11:52.944666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-7f29d813-008c-4908-8488-0f68506225f6 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "DELETE /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 404 len: 111 microversion: 2.1 time: 0.073909 Jun 06 21:11:52.944666 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 403/845] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:11:52 2022] DELETE /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:11:52.947971 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-05dcd41c-e300-450c-8f61-62664c904e27 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:52.949051 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-05dcd41c-e300-450c-8f61-62664c904e27 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 8a6a1d28-5f70-418f-8991-139855579e13] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:52.961094 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-05dcd41c-e300-450c-8f61-62664c904e27 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:52.961554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-05dcd41c-e300-450c-8f61-62664c904e27 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:52.962813 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-05dcd41c-e300-450c-8f61-62664c904e27 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:52.963441 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-05dcd41c-e300-450c-8f61-62664c904e27 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:53.004182 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-05dcd41c-e300-450c-8f61-62664c904e27 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] HTTP exception thrown: Instance 8a6a1d28-5f70-418f-8991-139855579e13 could not be found. Jun 06 21:11:53.005841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-05dcd41c-e300-450c-8f61-62664c904e27 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Request method failure captured: Jun 06 21:11:53.005841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 HTTP/1.1 Jun 06 21:11:53.005841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:11:53.005841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:11:53.005841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:11:53.005841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:11:53.005841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:11:53.005841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:11:53.005841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:11:53.005841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:11:53.005841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinmvxW1bVEWZVhCRlgeG6PDmaOvHpznA6mf68h7fAFngISNh4GnD9XFqvo52ymtA4PTaTSN-lCxDTYk7dFVIPU5elkSuX6Hf8rm-_SR1iR7N3wUEkc6KR6wmwlcMFMA3l3v8mmff7I1soQTiyS_qgppqz32gWX7gOKmiYav_WF1YU4TA Jun 06 21:11:53.005841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:11:53.005841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:11:53.005841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:11:53.005841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:11:53.005841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:11:53.005841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:11:53.005841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:11:53.005841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:53.005841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:11:53.005841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:11:53.008299 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:11:53.008299 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:53.008299 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:11:53.008299 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:53.008299 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:11:53.008299 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:11:53.008299 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:11:53.008299 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: 8713cb23a93147f8b52f88e240c81d6f Jun 06 21:11:53.008299 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:11:53.008299 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: > Jun 06 21:11:53.008299 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Instance 8a6a1d28-5f70-418f-8991-139855579e13 could not be found. Jun 06 21:11:53.008299 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '8a6a1d28-5f70-418f-8991-139855579e13'} Jun 06 21:11:53.009976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:11:53.009976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:53.009976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:11:53.009976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:11:53.009976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:11:53.009976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:11:53.009976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:11:53.009976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:11:53.009976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:11:53.009976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:11:53.009976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a6a1d28-5f70-418f-8991-139855579e13 could not be found. Jun 06 21:11:53.009976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:53.009976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:53.009976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:53.009976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:53.009976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:53.009976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:53.009976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:11:53.009976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:11:53.009976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:11:53.013545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:11:53.013545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:11:53.013545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:11:53.013545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:11:53.013545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:11:53.013545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:11:53.013545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:11:53.013545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a6a1d28-5f70-418f-8991-139855579e13 could not be found. Jun 06 21:11:53.013545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:53.013545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:53.013545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:53.013545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:53.013545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:53.013545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:53.013545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:11:53.013545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:11:53.013545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a6a1d28-5f70-418f-8991-139855579e13 could not be found. Jun 06 21:11:53.013545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:53.021759 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-05dcd41c-e300-450c-8f61-62664c904e27 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Returning 404 to user: Instance 8a6a1d28-5f70-418f-8991-139855579e13 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:11:53.021759 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-05dcd41c-e300-450c-8f61-62664c904e27 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13" status: 404 len: 111 microversion: 2.1 time: 0.064167 Jun 06 21:11:53.021759 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 443/846] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:52 2022] GET /compute/v2.1/servers/8a6a1d28-5f70-418f-8991-139855579e13 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:11:54.319249 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b5d40299-9b79-4d64-bdc6-07466370bd64 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:54.320260 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-b5d40299-9b79-4d64-bdc6-07466370bd64 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:54.329507 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b5d40299-9b79-4d64-bdc6-07466370bd64 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:54.330722 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b5d40299-9b79-4d64-bdc6-07466370bd64 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:54.332126 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b5d40299-9b79-4d64-bdc6-07466370bd64 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:54.333042 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b5d40299-9b79-4d64-bdc6-07466370bd64 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:54.350172 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-b5d40299-9b79-4d64-bdc6-07466370bd64 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] HTTP exception thrown: Instance 67813627-cc4f-453f-8b8f-9cec9b130583 could not be found. Jun 06 21:11:54.352862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b5d40299-9b79-4d64-bdc6-07466370bd64 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Request method failure captured: Jun 06 21:11:54.352862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: DELETE /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 HTTP/1.1 Jun 06 21:11:54.352862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:11:54.352862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:11:54.352862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:11:54.352862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 0 Jun 06 21:11:54.352862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:11:54.352862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:11:54.352862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:11:54.352862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:11:54.352862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinmvxW1bVEWZVhCRlgeG6PDmaOvHpznA6mf68h7fAFngISNh4GnD9XFqvo52ymtA4PTaTSN-lCxDTYk7dFVIPU5elkSuX6Hf8rm-_SR1iR7N3wUEkc6KR6wmwlcMFMA3l3v8mmff7I1soQTiyS_qgppqz32gWX7gOKmiYav_WF1YU4TA Jun 06 21:11:54.352862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:11:54.352862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:11:54.352862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:11:54.352862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:11:54.352862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:11:54.352862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:11:54.352862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:11:54.352862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:54.352862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:11:54.352862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:11:54.354275 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:11:54.354275 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:54.354275 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:11:54.354275 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:54.354275 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:11:54.354275 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:11:54.354275 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:11:54.354275 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: 8713cb23a93147f8b52f88e240c81d6f Jun 06 21:11:54.354275 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:11:54.354275 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: > Jun 06 21:11:54.354275 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Instance 67813627-cc4f-453f-8b8f-9cec9b130583 could not be found. Jun 06 21:11:54.354275 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'id': '67813627-cc4f-453f-8b8f-9cec9b130583'} Jun 06 21:11:54.355053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:11:54.355053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:54.355053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:11:54.355053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:11:54.355053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:11:54.355053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:11:54.355053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:11:54.355053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:11:54.355053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:11:54.355053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:11:54.355053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67813627-cc4f-453f-8b8f-9cec9b130583 could not be found. Jun 06 21:11:54.355053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:54.355053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:54.355053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:54.355053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:54.355053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:54.355053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:54.355053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:11:54.355053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:11:54.355053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:11:54.356301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:11:54.356301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 21:11:54.356301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 21:11:54.356301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 21:11:54.356301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 21:11:54.356301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:11:54.356301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:11:54.356301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:11:54.356301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:11:54.356301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67813627-cc4f-453f-8b8f-9cec9b130583 could not be found. Jun 06 21:11:54.356301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:54.356301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:54.356301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:54.356301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:54.356301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:54.356301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:54.356301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:11:54.356301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:11:54.356301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67813627-cc4f-453f-8b8f-9cec9b130583 could not be found. Jun 06 21:11:54.356301 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:11:54.359630 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b5d40299-9b79-4d64-bdc6-07466370bd64 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Returning 404 to user: Instance 67813627-cc4f-453f-8b8f-9cec9b130583 could not be found. {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:11:54.360853 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-b5d40299-9b79-4d64-bdc6-07466370bd64 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "DELETE /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 404 len: 111 microversion: 2.1 time: 0.046184 Jun 06 21:11:54.362511 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 404/847] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:11:54 2022] DELETE /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 21:11:54.376084 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b71bc0dc-2d6c-427a-a5a7-c3af7e274677 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:54.377546 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b71bc0dc-2d6c-427a-a5a7-c3af7e274677 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] [instance: 67813627-cc4f-453f-8b8f-9cec9b130583] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:54.392903 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b71bc0dc-2d6c-427a-a5a7-c3af7e274677 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:54.394126 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b71bc0dc-2d6c-427a-a5a7-c3af7e274677 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:54.395727 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b71bc0dc-2d6c-427a-a5a7-c3af7e274677 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:54.396562 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b71bc0dc-2d6c-427a-a5a7-c3af7e274677 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:54.432560 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-b71bc0dc-2d6c-427a-a5a7-c3af7e274677 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] HTTP exception thrown: Instance 67813627-cc4f-453f-8b8f-9cec9b130583 could not be found. Jun 06 21:11:54.436028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b71bc0dc-2d6c-427a-a5a7-c3af7e274677 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Request method failure captured: Jun 06 21:11:54.436028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 HTTP/1.1 Jun 06 21:11:54.436028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:11:54.436028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:11:54.436028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:11:54.436028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:11:54.436028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:11:54.436028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:11:54.436028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:11:54.436028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:11:54.436028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinmvxW1bVEWZVhCRlgeG6PDmaOvHpznA6mf68h7fAFngISNh4GnD9XFqvo52ymtA4PTaTSN-lCxDTYk7dFVIPU5elkSuX6Hf8rm-_SR1iR7N3wUEkc6KR6wmwlcMFMA3l3v8mmff7I1soQTiyS_qgppqz32gWX7gOKmiYav_WF1YU4TA Jun 06 21:11:54.436028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:11:54.436028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:11:54.436028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:11:54.436028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:11:54.436028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:11:54.436028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:11:54.436028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:11:54.436028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:54.436028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:11:54.436028 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:11:54.437485 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a771f1ab27f40aca2d546901cdcecda"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:11:54.437485 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:54.437485 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 5a771f1ab27f40aca2d546901cdcecda Jun 06 21:11:54.437485 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-664033950 Jun 06 21:11:54.437485 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:11:54.437485 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:11:54.437485 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:11:54.437485 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: 8713cb23a93147f8b52f88e240c81d6f Jun 06 21:11:54.437485 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeNegativeTest-664033950-project Jun 06 21:11:54.437485 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: > Jun 06 21:11:54.437485 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Instance 67813627-cc4f-453f-8b8f-9cec9b130583 could not be found. Jun 06 21:11:54.437485 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '67813627-cc4f-453f-8b8f-9cec9b130583'} Jun 06 21:11:54.438464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:11:54.438464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:54.438464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:11:54.438464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:11:54.438464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:11:54.438464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:11:54.438464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:11:54.438464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:11:54.438464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:11:54.438464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:11:54.438464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67813627-cc4f-453f-8b8f-9cec9b130583 could not be found. Jun 06 21:11:54.438464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:54.438464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:54.438464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:54.438464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:54.438464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:54.438464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:54.438464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:11:54.438464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:11:54.438464 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:11:54.439695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:11:54.439695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:11:54.439695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:11:54.439695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:11:54.439695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:11:54.439695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:11:54.439695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:11:54.439695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67813627-cc4f-453f-8b8f-9cec9b130583 could not be found. Jun 06 21:11:54.439695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:54.439695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:11:54.439695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:54.439695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:11:54.439695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:11:54.439695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:11:54.439695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:11:54.439695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:11:54.439695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67813627-cc4f-453f-8b8f-9cec9b130583 could not be found. Jun 06 21:11:54.439695 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:11:54.442756 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b71bc0dc-2d6c-427a-a5a7-c3af7e274677 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] Returning 404 to user: Instance 67813627-cc4f-453f-8b8f-9cec9b130583 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:11:54.442756 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b71bc0dc-2d6c-427a-a5a7-c3af7e274677 tempest-AttachVolumeNegativeTest-664033950 tempest-AttachVolumeNegativeTest-664033950-project] 10.222.0.33 "GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583" status: 404 len: 111 microversion: 2.1 time: 0.070720 Jun 06 21:11:54.444162 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 444/848] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:54 2022] GET /compute/v2.1/servers/67813627-cc4f-453f-8b8f-9cec9b130583 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 21:11:56.342791 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-9bcba72f-739f-4e48-9345-542b6b737fd6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Action: 'create', calling method: .version_select at 0x7f2725f86310>, body: {"keypair": {"name": "tempest-keypair-1570763782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLsoPYEm3+qBtfK1c2E3EM8vm6x4y6fyAIqE/PYt5m09zLDAHm3ZW99msB0iNY+utO+0Gsyv10WOTO+FMpQN6hW9L0Sr05RHCfKcCRCwJU0Vy7eH3ekYj7HS2SsE0aggQ=="}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:11:56.360214 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-9bcba72f-739f-4e48-9345-542b6b737fd6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Getting quotas for project ce7fbb51b32d4342a7b06db4199b5638. Resources: {'key_pairs'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:11:56.365324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-9bcba72f-739f-4e48-9345-542b6b737fd6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Getting quotas for user 0ecf39d671ac4f52be5dd80a5ec55615 and project ce7fbb51b32d4342a7b06db4199b5638. Resources: {'key_pairs'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:11:56.394442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-9bcba72f-739f-4e48-9345-542b6b737fd6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.217706 Jun 06 21:11:56.395022 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 405/849] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jun 6 21:11:56 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:11:58.454761 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4d992466-dde7-42bc-b3b4-c306155077eb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1456024161", "imageRef": "e4266a01-7d22-4036-91e8-3ec50e3369c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6fc44ae-ef2f-46ec-8b82-c29866d88b50"}], "security_groups": [{"name": "tempest-securitygroup--781076483"}], "key_name": "tempest-keypair-1570763782", "user_data": "}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:11:58.587865 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-4d992466-dde7-42bc-b3b4-c306155077eb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] validate_networks() for [('c6fc44ae-ef2f-46ec-8b82-c29866d88b50', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 21:11:59.583017 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-4d992466-dde7-42bc-b3b4-c306155077eb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 21:11:59.583850 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-4d992466-dde7-42bc-b3b4-c306155077eb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 21:11:59.583850 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-4d992466-dde7-42bc-b3b4-c306155077eb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 21:11:59.586062 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-4d992466-dde7-42bc-b3b4-c306155077eb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 21:11:59.586186 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-4d992466-dde7-42bc-b3b4-c306155077eb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 21:11:59.597870 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4d992466-dde7-42bc-b3b4-c306155077eb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:59.598628 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4d992466-dde7-42bc-b3b4-c306155077eb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:59.599426 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4d992466-dde7-42bc-b3b4-c306155077eb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:11:59.600339 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4d992466-dde7-42bc-b3b4-c306155077eb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:11:59.633482 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-4d992466-dde7-42bc-b3b4-c306155077eb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Getting quotas for project ce7fbb51b32d4342a7b06db4199b5638. Resources: {'ram', 'cores', 'instances'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:11:59.639042 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-4d992466-dde7-42bc-b3b4-c306155077eb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Getting quotas for user 0ecf39d671ac4f52be5dd80a5ec55615 and project ce7fbb51b32d4342a7b06db4199b5638. Resources: {'ram', 'cores', 'instances'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:11:59.653868 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4d992466-dde7-42bc-b3b4-c306155077eb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 21:11:59.656643 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4d992466-dde7-42bc-b3b4-c306155077eb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4266a01-7d22-4036-91e8-3ec50e3369c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 21:11:59.670046 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:59.726169 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4d992466-dde7-42bc-b3b4-c306155077eb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.280752 Jun 06 21:11:59.727211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 445/850] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 6 21:11:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 1283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 21:11:59.747111 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0c724151-3b91-453a-a6e6-1c30d461b9b5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:11:59.751748 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-0c724151-3b91-453a-a6e6-1c30d461b9b5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:11:59.769586 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:11:59.915423 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-0c724151-3b91-453a-a6e6-1c30d461b9b5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:11:59.924257 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-0c724151-3b91-453a-a6e6-1c30d461b9b5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1238 microversion: 2.1 time: 0.190134 Jun 06 21:11:59.926200 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 406/851] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:11:59 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1238 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:12:00.946432 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-499249d4-449b-42ed-95cf-bb9bc883ddb2 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:12:00.947572 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-499249d4-449b-42ed-95cf-bb9bc883ddb2 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:12:00.955398 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-499249d4-449b-42ed-95cf-bb9bc883ddb2 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:00.956072 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-499249d4-449b-42ed-95cf-bb9bc883ddb2 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:00.956795 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-499249d4-449b-42ed-95cf-bb9bc883ddb2 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:00.957229 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-499249d4-449b-42ed-95cf-bb9bc883ddb2 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:01.047261 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-499249d4-449b-42ed-95cf-bb9bc883ddb2 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:12:01.064329 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-499249d4-449b-42ed-95cf-bb9bc883ddb2 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1290 microversion: 2.1 time: 0.123096 Jun 06 21:12:01.065760 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 446/852] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:12:00 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1290 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:12:02.092265 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-30348f95-b8f5-452a-a14e-fd5d83fd72fa tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:12:02.094304 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-30348f95-b8f5-452a-a14e-fd5d83fd72fa tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:12:02.108241 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-30348f95-b8f5-452a-a14e-fd5d83fd72fa tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:02.109048 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-30348f95-b8f5-452a-a14e-fd5d83fd72fa tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:02.110450 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-30348f95-b8f5-452a-a14e-fd5d83fd72fa tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:02.111231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-30348f95-b8f5-452a-a14e-fd5d83fd72fa tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:02.458558 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-30348f95-b8f5-452a-a14e-fd5d83fd72fa tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:12:02.467966 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-30348f95-b8f5-452a-a14e-fd5d83fd72fa tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1363 microversion: 2.1 time: 0.387579 Jun 06 21:12:02.468889 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 407/853] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:12:02 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1363 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:12:03.064341 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-bb29cb3a-16c6-49b5-865c-29a8b7c6972f req-95bb36f6-4449-4e9b-b76b-4e9c984fad0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce90b0bc-be67-4862-bac1-77835f2d7a0f", "tag": "fdfd6105-6b85-48fb-93c4-8ad8cf48940d"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:12:03.083638 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-bb29cb3a-16c6-49b5-865c-29a8b7c6972f req-95bb36f6-4449-4e9b-b76b-4e9c984fad0a service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:03.084619 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-bb29cb3a-16c6-49b5-865c-29a8b7c6972f req-95bb36f6-4449-4e9b-b76b-4e9c984fad0a service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:03.105981 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-bb29cb3a-16c6-49b5-865c-29a8b7c6972f req-95bb36f6-4449-4e9b-b76b-4e9c984fad0a service nova] Creating event network-changed:fdfd6105-6b85-48fb-93c4-8ad8cf48940d for instance ce90b0bc-be67-4862-bac1-77835f2d7a0f on hv-cinder-84488 Jun 06 21:12:03.112314 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-bb29cb3a-16c6-49b5-865c-29a8b7c6972f req-95bb36f6-4449-4e9b-b76b-4e9c984fad0a service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052751 Jun 06 21:12:03.113196 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 447/854] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:12:03.486766 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-56b18042-a937-48cc-8816-0a67d087bc25 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:12:03.488357 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-56b18042-a937-48cc-8816-0a67d087bc25 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:12:03.495811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-56b18042-a937-48cc-8816-0a67d087bc25 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:03.496277 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-56b18042-a937-48cc-8816-0a67d087bc25 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:03.497270 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-56b18042-a937-48cc-8816-0a67d087bc25 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:03.497937 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-56b18042-a937-48cc-8816-0a67d087bc25 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:03.675096 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-56b18042-a937-48cc-8816-0a67d087bc25 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:12:03.688299 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-56b18042-a937-48cc-8816-0a67d087bc25 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1363 microversion: 2.1 time: 0.205200 Jun 06 21:12:03.689374 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 408/855] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:12:03 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1363 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:12:04.714868 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-14ea09d3-934f-40d8-ab05-5893bc0436dc tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:12:04.715630 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-14ea09d3-934f-40d8-ab05-5893bc0436dc tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:12:04.722482 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-14ea09d3-934f-40d8-ab05-5893bc0436dc tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:04.722924 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-14ea09d3-934f-40d8-ab05-5893bc0436dc tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:04.723933 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-14ea09d3-934f-40d8-ab05-5893bc0436dc tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:04.724441 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-14ea09d3-934f-40d8-ab05-5893bc0436dc tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:04.871197 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-14ea09d3-934f-40d8-ab05-5893bc0436dc tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:12:04.879129 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-14ea09d3-934f-40d8-ab05-5893bc0436dc tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1363 microversion: 2.1 time: 0.169101 Jun 06 21:12:04.879729 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 448/856] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:12:04 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:12:05.899688 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-d14127ce-dccb-4ab5-a52f-5ff10027fbb1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:12:05.900612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-d14127ce-dccb-4ab5-a52f-5ff10027fbb1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:12:05.909447 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d14127ce-dccb-4ab5-a52f-5ff10027fbb1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:05.909858 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d14127ce-dccb-4ab5-a52f-5ff10027fbb1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:05.910721 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d14127ce-dccb-4ab5-a52f-5ff10027fbb1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:05.911224 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d14127ce-dccb-4ab5-a52f-5ff10027fbb1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:06.062332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-d14127ce-dccb-4ab5-a52f-5ff10027fbb1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:12:06.070465 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-d14127ce-dccb-4ab5-a52f-5ff10027fbb1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1363 microversion: 2.1 time: 0.176607 Jun 06 21:12:06.071050 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 409/857] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:12:05 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:12:07.089103 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-bf0f6f79-706d-4d0f-a687-9d0205b72172 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:12:07.089897 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-bf0f6f79-706d-4d0f-a687-9d0205b72172 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:12:07.097514 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf0f6f79-706d-4d0f-a687-9d0205b72172 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:07.098176 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf0f6f79-706d-4d0f-a687-9d0205b72172 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:07.099002 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf0f6f79-706d-4d0f-a687-9d0205b72172 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:07.099554 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-bf0f6f79-706d-4d0f-a687-9d0205b72172 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:07.263560 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-bf0f6f79-706d-4d0f-a687-9d0205b72172 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:12:07.272887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-bf0f6f79-706d-4d0f-a687-9d0205b72172 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1363 microversion: 2.1 time: 0.187943 Jun 06 21:12:07.274073 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 449/858] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:12:07 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:12:08.290791 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b5d2f9ea-783e-43e9-aadd-3af8f2f9cfe9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:12:08.291367 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-b5d2f9ea-783e-43e9-aadd-3af8f2f9cfe9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:12:08.298599 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b5d2f9ea-783e-43e9-aadd-3af8f2f9cfe9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:08.299151 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b5d2f9ea-783e-43e9-aadd-3af8f2f9cfe9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:08.300627 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b5d2f9ea-783e-43e9-aadd-3af8f2f9cfe9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:08.301129 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b5d2f9ea-783e-43e9-aadd-3af8f2f9cfe9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:08.461018 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-b5d2f9ea-783e-43e9-aadd-3af8f2f9cfe9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:12:08.473134 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-b5d2f9ea-783e-43e9-aadd-3af8f2f9cfe9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1363 microversion: 2.1 time: 0.186051 Jun 06 21:12:08.473713 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 410/859] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:12:08 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:12:08.854516 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-ed7c7c46-ce1b-468a-904b-104a852526c5 req-92d26beb-6c46-418a-979e-395595a1d84b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce90b0bc-be67-4862-bac1-77835f2d7a0f", "name": "network-vif-plugged", "status": "completed", "tag": "fdfd6105-6b85-48fb-93c4-8ad8cf48940d"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:12:08.863730 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-ed7c7c46-ce1b-468a-904b-104a852526c5 req-92d26beb-6c46-418a-979e-395595a1d84b service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:08.864324 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-ed7c7c46-ce1b-468a-904b-104a852526c5 req-92d26beb-6c46-418a-979e-395595a1d84b service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:08.868807 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:08.876968 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-ed7c7c46-ce1b-468a-904b-104a852526c5 req-92d26beb-6c46-418a-979e-395595a1d84b service nova] Creating event network-vif-plugged:fdfd6105-6b85-48fb-93c4-8ad8cf48940d for instance ce90b0bc-be67-4862-bac1-77835f2d7a0f on hv-cinder-84488 Jun 06 21:12:08.882615 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-ed7c7c46-ce1b-468a-904b-104a852526c5 req-92d26beb-6c46-418a-979e-395595a1d84b service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031773 Jun 06 21:12:08.883418 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 450/860] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:12:09.491896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-809152ce-f352-49e3-8573-0da3725e9f14 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:12:09.493025 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-809152ce-f352-49e3-8573-0da3725e9f14 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:12:09.500083 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-809152ce-f352-49e3-8573-0da3725e9f14 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:09.500542 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-809152ce-f352-49e3-8573-0da3725e9f14 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:09.501473 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-809152ce-f352-49e3-8573-0da3725e9f14 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:09.501971 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-809152ce-f352-49e3-8573-0da3725e9f14 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:09.654951 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-809152ce-f352-49e3-8573-0da3725e9f14 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:12:09.663401 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-809152ce-f352-49e3-8573-0da3725e9f14 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1363 microversion: 2.1 time: 0.176853 Jun 06 21:12:09.663984 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 411/861] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:12:09 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:12:10.681797 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1ae1daaf-2b6b-4281-b270-b9b41957f3e0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:12:10.682463 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1ae1daaf-2b6b-4281-b270-b9b41957f3e0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:12:10.684501 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:10.685152 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=6 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:10.693280 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ae1daaf-2b6b-4281-b270-b9b41957f3e0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:10.693722 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ae1daaf-2b6b-4281-b270-b9b41957f3e0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:10.694514 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ae1daaf-2b6b-4281-b270-b9b41957f3e0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:10.694938 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1ae1daaf-2b6b-4281-b270-b9b41957f3e0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:10.846409 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1ae1daaf-2b6b-4281-b270-b9b41957f3e0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:12:10.854679 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1ae1daaf-2b6b-4281-b270-b9b41957f3e0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1548 microversion: 2.1 time: 0.177033 Jun 06 21:12:10.855258 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 451/862] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:12:10 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1548 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:12:10.871579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-ee58658d-f46c-4039-91c6-8bee81bff21a tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:12:10.872188 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-ee58658d-f46c-4039-91c6-8bee81bff21a tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:12:10.873999 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=6 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:10.880898 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ee58658d-f46c-4039-91c6-8bee81bff21a tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:10.881446 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ee58658d-f46c-4039-91c6-8bee81bff21a tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:10.882106 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ee58658d-f46c-4039-91c6-8bee81bff21a tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:10.882533 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ee58658d-f46c-4039-91c6-8bee81bff21a tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:10.886792 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:10.964616 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-ee58658d-f46c-4039-91c6-8bee81bff21a tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096935 Jun 06 21:12:10.965219 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 412/863] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jun 6 21:12:10 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:12:11.991563 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-d1d9bf6b-7f0b-44ca-a18f-261c6e10c0d6 req-b4d8df81-8eaa-40f0-9482-e72166e158f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce90b0bc-be67-4862-bac1-77835f2d7a0f", "tag": "fdfd6105-6b85-48fb-93c4-8ad8cf48940d"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:12:12.003278 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-d1d9bf6b-7f0b-44ca-a18f-261c6e10c0d6 req-b4d8df81-8eaa-40f0-9482-e72166e158f0 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:12.004075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-d1d9bf6b-7f0b-44ca-a18f-261c6e10c0d6 req-b4d8df81-8eaa-40f0-9482-e72166e158f0 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:12.018932 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-d1d9bf6b-7f0b-44ca-a18f-261c6e10c0d6 req-b4d8df81-8eaa-40f0-9482-e72166e158f0 service nova] Creating event network-changed:fdfd6105-6b85-48fb-93c4-8ad8cf48940d for instance ce90b0bc-be67-4862-bac1-77835f2d7a0f on hv-cinder-84488 Jun 06 21:12:12.024575 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-d1d9bf6b-7f0b-44ca-a18f-261c6e10c0d6 req-b4d8df81-8eaa-40f0-9482-e72166e158f0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037782 Jun 06 21:12:12.025288 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 452/864] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:12:14.163089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-9c2b51c5-d716-4538-97bd-add746554078 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:12:14.164153 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-9c2b51c5-d716-4538-97bd-add746554078 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:12:14.170678 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9c2b51c5-d716-4538-97bd-add746554078 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:14.171269 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9c2b51c5-d716-4538-97bd-add746554078 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:14.172053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9c2b51c5-d716-4538-97bd-add746554078 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:14.172532 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9c2b51c5-d716-4538-97bd-add746554078 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:14.205206 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-9c2b51c5-d716-4538-97bd-add746554078 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046639 Jun 06 21:12:14.205789 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 413/865] 10.222.0.33 () {60 vars in 1342 bytes} [Mon Jun 6 21:12:14 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:12:14.273224 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1d33ca49-0b13-4e13-9575-5dca6c46e6f4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:12:14.273911 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1d33ca49-0b13-4e13-9575-5dca6c46e6f4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:12:14.280995 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d33ca49-0b13-4e13-9575-5dca6c46e6f4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:14.281456 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d33ca49-0b13-4e13-9575-5dca6c46e6f4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:14.282184 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d33ca49-0b13-4e13-9575-5dca6c46e6f4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:14.282602 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1d33ca49-0b13-4e13-9575-5dca6c46e6f4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:14.309532 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1d33ca49-0b13-4e13-9575-5dca6c46e6f4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 21:12:14.393404 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1d33ca49-0b13-4e13-9575-5dca6c46e6f4 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 204 len: 0 microversion: 2.20 time: 0.124960 Jun 06 21:12:14.394355 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 453/866] 10.222.0.33 () {60 vars in 1279 bytes} [Mon Jun 6 21:12:14 2022] DELETE /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 06 21:12:14.403006 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-c6f77a1c-baab-4784-be4b-c5b1aec5b168 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:12:14.403729 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-c6f77a1c-baab-4784-be4b-c5b1aec5b168 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:12:14.412377 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c6f77a1c-baab-4784-be4b-c5b1aec5b168 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:14.412872 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c6f77a1c-baab-4784-be4b-c5b1aec5b168 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:14.413661 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c6f77a1c-baab-4784-be4b-c5b1aec5b168 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:14.414171 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c6f77a1c-baab-4784-be4b-c5b1aec5b168 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:14.566261 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c6f77a1c-baab-4784-be4b-c5b1aec5b168 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:12:14.574896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c6f77a1c-baab-4784-be4b-c5b1aec5b168 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:12:14.576414 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c6f77a1c-baab-4784-be4b-c5b1aec5b168 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:12:14.577935 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-c6f77a1c-baab-4784-be4b-c5b1aec5b168 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1721 microversion: 2.20 time: 0.179279 Jun 06 21:12:14.578484 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 414/867] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:12:14 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:12:15.597767 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-594f6557-23cd-4b9b-ad61-f1b34276f8e6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:12:15.598480 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-594f6557-23cd-4b9b-ad61-f1b34276f8e6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:12:15.605345 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-594f6557-23cd-4b9b-ad61-f1b34276f8e6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:15.606083 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-594f6557-23cd-4b9b-ad61-f1b34276f8e6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:15.612830 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-594f6557-23cd-4b9b-ad61-f1b34276f8e6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:15.613273 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-594f6557-23cd-4b9b-ad61-f1b34276f8e6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:15.769761 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-594f6557-23cd-4b9b-ad61-f1b34276f8e6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:12:15.778135 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-594f6557-23cd-4b9b-ad61-f1b34276f8e6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:12:15.779663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-594f6557-23cd-4b9b-ad61-f1b34276f8e6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:12:15.781140 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-594f6557-23cd-4b9b-ad61-f1b34276f8e6 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1721 microversion: 2.20 time: 0.187572 Jun 06 21:12:15.784757 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 454/868] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:12:15 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1721 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:12:16.802280 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-502ed634-667e-431f-9521-06ad3d06b7b1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:12:16.803763 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-502ed634-667e-431f-9521-06ad3d06b7b1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:12:16.812496 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-502ed634-667e-431f-9521-06ad3d06b7b1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:16.813770 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-502ed634-667e-431f-9521-06ad3d06b7b1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:16.815458 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-502ed634-667e-431f-9521-06ad3d06b7b1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:16.816387 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-502ed634-667e-431f-9521-06ad3d06b7b1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:16.875853 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-0107c3ff-7d1e-47e3-a182-4f6738b61510 req-c03b8e84-f289-4240-aace-0ffddb9f4f0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5670bfe4-7e75-44cc-93c9-59dbaad0a0b2", "name": "network-vif-deleted", "tag": "04c1ea5e-e07f-49da-aad5-775bd6da5cac"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:12:16.897916 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-0107c3ff-7d1e-47e3-a182-4f6738b61510 req-c03b8e84-f289-4240-aace-0ffddb9f4f0e service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:16.898538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-0107c3ff-7d1e-47e3-a182-4f6738b61510 req-c03b8e84-f289-4240-aace-0ffddb9f4f0e service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:16.918716 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-502ed634-667e-431f-9521-06ad3d06b7b1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:12:16.937037 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-0107c3ff-7d1e-47e3-a182-4f6738b61510 req-c03b8e84-f289-4240-aace-0ffddb9f4f0e service nova] Creating event network-vif-deleted:04c1ea5e-e07f-49da-aad5-775bd6da5cac for instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 on hv-cinder-84488 Jun 06 21:12:16.939610 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-502ed634-667e-431f-9521-06ad3d06b7b1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:12:16.942361 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-502ed634-667e-431f-9521-06ad3d06b7b1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '602aaa469bed4617b1a0385087066c93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '576ccf22c37f44fcbe449838cb5673f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:12:16.943901 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-502ed634-667e-431f-9521-06ad3d06b7b1 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 200 len: 1654 microversion: 2.20 time: 0.146885 Jun 06 21:12:16.945743 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-0107c3ff-7d1e-47e3-a182-4f6738b61510 req-c03b8e84-f289-4240-aace-0ffddb9f4f0e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074536 Jun 06 21:12:16.946462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 455/869] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:12:16.955485 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 415/870] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:12:16 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 1654 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 21:12:17.972669 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-421c9755-9667-41c8-bbd3-9593ac8ada82 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:12:17.974486 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-421c9755-9667-41c8-bbd3-9593ac8ada82 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:12:17.985036 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-421c9755-9667-41c8-bbd3-9593ac8ada82 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:17.985918 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-421c9755-9667-41c8-bbd3-9593ac8ada82 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:17.987350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-421c9755-9667-41c8-bbd3-9593ac8ada82 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:17.988130 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-421c9755-9667-41c8-bbd3-9593ac8ada82 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:18.010757 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-421c9755-9667-41c8-bbd3-9593ac8ada82 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] HTTP exception thrown: Instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 could not be found. Jun 06 21:12:18.013974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-421c9755-9667-41c8-bbd3-9593ac8ada82 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Request method failure captured: Jun 06 21:12:18.013974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 HTTP/1.1 Jun 06 21:12:18.013974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:12:18.013974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:12:18.013974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:12:18.013974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:12:18.013974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:12:18.013974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:12:18.013974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:12:18.013974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:12:18.013974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinmv_Hfhoy2QIopvOFM_96dkn6fhickDDxWtLiCyMewMq7-juzpNdxvYYZBIbKRfj3oHrWrKKD9DkfvUIX07YIBE2h_l4prVGC9U1v_r9lQ9TF648VZtk4TB5mA_nn5gz6Anm1H4Q0OPa9D61Bl54OhTn_NVncQCLkKTdKNCXSb6ENjs Jun 06 21:12:18.013974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:12:18.013974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:12:18.013974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:12:18.013974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:12:18.013974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 21:12:18.013974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:12:18.013974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:12:18.013974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 576ccf22c37f44fcbe449838cb5673f6 Jun 06 21:12:18.013974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-440411712 Jun 06 21:12:18.013974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:12:18.013974 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:12:18.015797 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:12:18.015797 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeShelveTestJSON-440411712 Jun 06 21:12:18.015797 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 576ccf22c37f44fcbe449838cb5673f6 Jun 06 21:12:18.015797 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-440411712 Jun 06 21:12:18.015797 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeShelveTestJSON-440411712-project Jun 06 21:12:18.015797 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:12:18.015797 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:12:18.015797 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: 602aaa469bed4617b1a0385087066c93 Jun 06 21:12:18.015797 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeShelveTestJSON-440411712-project Jun 06 21:12:18.015797 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: > Jun 06 21:12:18.015797 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 could not be found. Jun 06 21:12:18.015797 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '5670bfe4-7e75-44cc-93c9-59dbaad0a0b2'} Jun 06 21:12:18.016663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:12:18.016663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:12:18.016663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:12:18.016663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:12:18.016663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:12:18.016663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:12:18.016663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:12:18.016663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:12:18.016663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:12:18.016663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:12:18.016663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 could not be found. Jun 06 21:12:18.016663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:12:18.016663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:12:18.016663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:12:18.016663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:12:18.016663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:12:18.016663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:12:18.016663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:12:18.016663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:12:18.016663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:12:18.017971 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:12:18.017971 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:12:18.017971 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:12:18.017971 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:12:18.017971 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:12:18.017971 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:12:18.017971 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:12:18.017971 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 could not be found. Jun 06 21:12:18.017971 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:12:18.017971 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:12:18.017971 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:12:18.017971 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:12:18.017971 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:12:18.017971 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:12:18.017971 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:12:18.017971 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:12:18.017971 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 could not be found. Jun 06 21:12:18.017971 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:12:18.019184 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-421c9755-9667-41c8-bbd3-9593ac8ada82 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Returning 404 to user: Instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:12:18.019184 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-421c9755-9667-41c8-bbd3-9593ac8ada82 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 404 len: 111 microversion: 2.20 time: 0.052126 Jun 06 21:12:18.023234 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 456/871] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:12:17 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 21:12:18.029293 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-785ba50c-788b-4d91-89cf-5b479ec04a19 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '.version_select at 0x7f2725f815e0>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:12:18.058622 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-785ba50c-788b-4d91-89cf-5b479ec04a19 tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-84051738" status: 204 len: 0 microversion: 2.20 time: 0.033643 Jun 06 21:12:18.059148 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 416/872] 10.222.0.33 () {60 vars in 1255 bytes} [Mon Jun 6 21:12:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-84051738 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 06 21:12:20.006143 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d77f7521-8ded-4652-97f1-d4278ebd793e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:12:20.006781 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d77f7521-8ded-4652-97f1-d4278ebd793e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:12:20.014652 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d77f7521-8ded-4652-97f1-d4278ebd793e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:20.015100 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d77f7521-8ded-4652-97f1-d4278ebd793e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:20.015918 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d77f7521-8ded-4652-97f1-d4278ebd793e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:20.016758 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d77f7521-8ded-4652-97f1-d4278ebd793e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:20.033622 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-d77f7521-8ded-4652-97f1-d4278ebd793e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] HTTP exception thrown: Instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 could not be found. Jun 06 21:12:20.035304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d77f7521-8ded-4652-97f1-d4278ebd793e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Request method failure captured: Jun 06 21:12:20.035304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: DELETE /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 HTTP/1.1 Jun 06 21:12:20.035304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:12:20.035304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:12:20.035304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:12:20.035304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:12:20.035304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:12:20.035304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:12:20.035304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:12:20.035304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:12:20.035304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinmv_Hfhoy2QIopvOFM_96dkn6fhickDDxWtLiCyMewMq7-juzpNdxvYYZBIbKRfj3oHrWrKKD9DkfvUIX07YIBE2h_l4prVGC9U1v_r9lQ9TF648VZtk4TB5mA_nn5gz6Anm1H4Q0OPa9D61Bl54OhTn_NVncQCLkKTdKNCXSb6ENjs Jun 06 21:12:20.035304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:12:20.035304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:12:20.035304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:12:20.035304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:12:20.035304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 21:12:20.035304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:12:20.035304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:12:20.035304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 576ccf22c37f44fcbe449838cb5673f6 Jun 06 21:12:20.035304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-440411712 Jun 06 21:12:20.035304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:12:20.035304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:12:20.038286 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:12:20.038286 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeShelveTestJSON-440411712 Jun 06 21:12:20.038286 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 576ccf22c37f44fcbe449838cb5673f6 Jun 06 21:12:20.038286 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-440411712 Jun 06 21:12:20.038286 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeShelveTestJSON-440411712-project Jun 06 21:12:20.038286 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:12:20.038286 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:12:20.038286 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: 602aaa469bed4617b1a0385087066c93 Jun 06 21:12:20.038286 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeShelveTestJSON-440411712-project Jun 06 21:12:20.038286 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: > Jun 06 21:12:20.038286 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 could not be found. Jun 06 21:12:20.038286 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '5670bfe4-7e75-44cc-93c9-59dbaad0a0b2'} Jun 06 21:12:20.039214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:12:20.039214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:12:20.039214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:12:20.039214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:12:20.039214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:12:20.039214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:12:20.039214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:12:20.039214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:12:20.039214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:12:20.039214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:12:20.039214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 could not be found. Jun 06 21:12:20.039214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:12:20.039214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:12:20.039214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:12:20.039214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:12:20.039214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:12:20.039214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:12:20.039214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:12:20.039214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:12:20.039214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:12:20.040480 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:12:20.040480 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 21:12:20.040480 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 21:12:20.040480 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 21:12:20.040480 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 21:12:20.040480 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:12:20.040480 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:12:20.040480 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:12:20.040480 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:12:20.040480 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 could not be found. Jun 06 21:12:20.040480 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:12:20.040480 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:12:20.040480 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:12:20.040480 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:12:20.040480 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:12:20.040480 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:12:20.040480 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:12:20.040480 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:12:20.040480 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 could not be found. Jun 06 21:12:20.040480 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:12:20.044298 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d77f7521-8ded-4652-97f1-d4278ebd793e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Returning 404 to user: Instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:12:20.044298 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d77f7521-8ded-4652-97f1-d4278ebd793e tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "DELETE /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 404 len: 111 microversion: 2.20 time: 0.035656 Jun 06 21:12:20.044298 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 457/873] 10.222.0.33 () {60 vars in 1279 bytes} [Mon Jun 6 21:12:20 2022] DELETE /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 06 21:12:20.047985 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0e4c21ac-ed96-45bb-ad1a-97da563d84ec tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:12:20.049303 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-0e4c21ac-ed96-45bb-ad1a-97da563d84ec tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:12:20.058994 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0e4c21ac-ed96-45bb-ad1a-97da563d84ec tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:20.059436 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0e4c21ac-ed96-45bb-ad1a-97da563d84ec tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:20.060403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0e4c21ac-ed96-45bb-ad1a-97da563d84ec tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:20.060845 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0e4c21ac-ed96-45bb-ad1a-97da563d84ec tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:20.086865 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-0e4c21ac-ed96-45bb-ad1a-97da563d84ec tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] HTTP exception thrown: Instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 could not be found. Jun 06 21:12:20.089107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0e4c21ac-ed96-45bb-ad1a-97da563d84ec tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Request method failure captured: Jun 06 21:12:20.089107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 HTTP/1.1 Jun 06 21:12:20.089107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:12:20.089107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:12:20.089107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:12:20.089107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 0 Jun 06 21:12:20.089107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:12:20.089107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:12:20.089107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:12:20.089107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:12:20.089107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinmv_Hfhoy2QIopvOFM_96dkn6fhickDDxWtLiCyMewMq7-juzpNdxvYYZBIbKRfj3oHrWrKKD9DkfvUIX07YIBE2h_l4prVGC9U1v_r9lQ9TF648VZtk4TB5mA_nn5gz6Anm1H4Q0OPa9D61Bl54OhTn_NVncQCLkKTdKNCXSb6ENjs Jun 06 21:12:20.089107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:12:20.089107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:12:20.089107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:12:20.089107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:12:20.089107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 21:12:20.089107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:12:20.089107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:12:20.089107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: 576ccf22c37f44fcbe449838cb5673f6 Jun 06 21:12:20.089107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-440411712 Jun 06 21:12:20.089107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:12:20.089107 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:12:20.090506 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:12:20.090506 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-AttachVolumeShelveTestJSON-440411712 Jun 06 21:12:20.090506 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: 576ccf22c37f44fcbe449838cb5673f6 Jun 06 21:12:20.090506 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-440411712 Jun 06 21:12:20.090506 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-AttachVolumeShelveTestJSON-440411712-project Jun 06 21:12:20.090506 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:12:20.090506 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:12:20.090506 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: 602aaa469bed4617b1a0385087066c93 Jun 06 21:12:20.090506 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-AttachVolumeShelveTestJSON-440411712-project Jun 06 21:12:20.090506 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: > Jun 06 21:12:20.090506 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 could not be found. Jun 06 21:12:20.090506 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'id': '5670bfe4-7e75-44cc-93c9-59dbaad0a0b2'} Jun 06 21:12:20.091327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:12:20.091327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:12:20.091327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:12:20.091327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:12:20.091327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:12:20.091327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:12:20.091327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:12:20.091327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:12:20.091327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:12:20.091327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:12:20.091327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 could not be found. Jun 06 21:12:20.091327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:12:20.091327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:12:20.091327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:12:20.091327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:12:20.091327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:12:20.091327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:12:20.091327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:12:20.091327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:12:20.091327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:12:20.092764 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:12:20.092764 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:12:20.092764 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:12:20.092764 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:12:20.092764 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:12:20.092764 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:12:20.092764 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:12:20.092764 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 could not be found. Jun 06 21:12:20.092764 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:12:20.092764 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:12:20.092764 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:12:20.092764 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:12:20.092764 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:12:20.092764 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:12:20.092764 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:12:20.092764 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:12:20.092764 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 could not be found. Jun 06 21:12:20.092764 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:12:20.094332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0e4c21ac-ed96-45bb-ad1a-97da563d84ec tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Returning 404 to user: Instance 5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 could not be found. {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:12:20.094332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-0e4c21ac-ed96-45bb-ad1a-97da563d84ec tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2" status: 404 len: 111 microversion: 2.20 time: 0.047509 Jun 06 21:12:20.094332 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 417/874] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:12:20 2022] GET /compute/v2.1/servers/5670bfe4-7e75-44cc-93c9-59dbaad0a0b2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 21:12:21.252396 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7e3b0d78-d901-4da5-95d3-9fa0fb572d4c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:12:21.253060 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-7e3b0d78-d901-4da5-95d3-9fa0fb572d4c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:12:21.261059 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7e3b0d78-d901-4da5-95d3-9fa0fb572d4c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:21.261506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7e3b0d78-d901-4da5-95d3-9fa0fb572d4c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:21.262303 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7e3b0d78-d901-4da5-95d3-9fa0fb572d4c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:21.262737 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-7e3b0d78-d901-4da5-95d3-9fa0fb572d4c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:21.278325 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-7e3b0d78-d901-4da5-95d3-9fa0fb572d4c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] HTTP exception thrown: Instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 could not be found. Jun 06 21:12:21.280076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7e3b0d78-d901-4da5-95d3-9fa0fb572d4c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Request method failure captured: Jun 06 21:12:21.280076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: DELETE /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 HTTP/1.1 Jun 06 21:12:21.280076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:12:21.280076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:12:21.280076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:12:21.280076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:12:21.280076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:12:21.280076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:12:21.280076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:12:21.280076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:12:21.280076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinmv_Hfhoy2QIopvOFM_96dkn6fhickDDxWtLiCyMewMq7-juzpNdxvYYZBIbKRfj3oHrWrKKD9DkfvUIX07YIBE2h_l4prVGC9U1v_r9lQ9TF648VZtk4TB5mA_nn5gz6Anm1H4Q0OPa9D61Bl54OhTn_NVncQCLkKTdKNCXSb6ENjs Jun 06 21:12:21.280076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:12:21.280076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:12:21.280076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:12:21.280076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:12:21.280076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 21:12:21.280076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:12:21.280076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:12:21.280076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: 576ccf22c37f44fcbe449838cb5673f6 Jun 06 21:12:21.280076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-440411712 Jun 06 21:12:21.280076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:12:21.280076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:12:21.282000 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:12:21.282000 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeShelveTestJSON-440411712 Jun 06 21:12:21.282000 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: 576ccf22c37f44fcbe449838cb5673f6 Jun 06 21:12:21.282000 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-440411712 Jun 06 21:12:21.282000 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeShelveTestJSON-440411712-project Jun 06 21:12:21.282000 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:12:21.282000 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:12:21.282000 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: 602aaa469bed4617b1a0385087066c93 Jun 06 21:12:21.282000 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeShelveTestJSON-440411712-project Jun 06 21:12:21.282000 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: > Jun 06 21:12:21.282000 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 could not be found. Jun 06 21:12:21.282000 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '1886e3bf-c735-4f91-8a2f-0bc6996982e0'} Jun 06 21:12:21.282842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:12:21.282842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:12:21.282842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:12:21.282842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:12:21.282842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:12:21.282842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:12:21.282842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:12:21.282842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:12:21.282842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:12:21.282842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:12:21.282842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 could not be found. Jun 06 21:12:21.282842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:12:21.282842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:12:21.282842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:12:21.282842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:12:21.282842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:12:21.282842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:12:21.282842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:12:21.282842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:12:21.282842 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:12:21.284436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:12:21.284436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 21:12:21.284436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 21:12:21.284436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 21:12:21.284436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 21:12:21.284436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:12:21.284436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:12:21.284436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:12:21.284436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:12:21.284436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 could not be found. Jun 06 21:12:21.284436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:12:21.284436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:12:21.284436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:12:21.284436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:12:21.284436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:12:21.284436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:12:21.284436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:12:21.284436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:12:21.284436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 could not be found. Jun 06 21:12:21.284436 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:12:21.285828 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7e3b0d78-d901-4da5-95d3-9fa0fb572d4c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Returning 404 to user: Instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:12:21.285828 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7e3b0d78-d901-4da5-95d3-9fa0fb572d4c tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "DELETE /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 404 len: 111 microversion: 2.20 time: 0.033380 Jun 06 21:12:21.285828 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 458/875] 10.222.0.33 () {60 vars in 1279 bytes} [Mon Jun 6 21:12:21 2022] DELETE /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 21:12:21.291788 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-45dd0808-fe35-45c9-ba9b-21804d03194a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:12:21.292438 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-45dd0808-fe35-45c9-ba9b-21804d03194a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] [instance: 1886e3bf-c735-4f91-8a2f-0bc6996982e0] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:12:21.299338 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-45dd0808-fe35-45c9-ba9b-21804d03194a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:21.299714 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-45dd0808-fe35-45c9-ba9b-21804d03194a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:21.300559 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-45dd0808-fe35-45c9-ba9b-21804d03194a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:21.300983 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-45dd0808-fe35-45c9-ba9b-21804d03194a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:21.315137 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-45dd0808-fe35-45c9-ba9b-21804d03194a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] HTTP exception thrown: Instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 could not be found. Jun 06 21:12:21.316800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-45dd0808-fe35-45c9-ba9b-21804d03194a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Request method failure captured: Jun 06 21:12:21.316800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 HTTP/1.1 Jun 06 21:12:21.316800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:12:21.316800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:12:21.316800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:12:21.316800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 0 Jun 06 21:12:21.316800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:12:21.316800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:12:21.316800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:12:21.316800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:12:21.316800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinmv_Hfhoy2QIopvOFM_96dkn6fhickDDxWtLiCyMewMq7-juzpNdxvYYZBIbKRfj3oHrWrKKD9DkfvUIX07YIBE2h_l4prVGC9U1v_r9lQ9TF648VZtk4TB5mA_nn5gz6Anm1H4Q0OPa9D61Bl54OhTn_NVncQCLkKTdKNCXSb6ENjs Jun 06 21:12:21.316800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:12:21.316800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:12:21.316800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:12:21.316800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:12:21.316800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 21:12:21.316800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:12:21.316800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:12:21.316800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: 576ccf22c37f44fcbe449838cb5673f6 Jun 06 21:12:21.316800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-440411712 Jun 06 21:12:21.316800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:12:21.316800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:12:21.319208 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/576ccf22c37f44fcbe449838cb5673f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:12:21.319208 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-AttachVolumeShelveTestJSON-440411712 Jun 06 21:12:21.319208 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: 576ccf22c37f44fcbe449838cb5673f6 Jun 06 21:12:21.319208 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-440411712 Jun 06 21:12:21.319208 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-AttachVolumeShelveTestJSON-440411712-project Jun 06 21:12:21.319208 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:12:21.319208 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:12:21.319208 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: 602aaa469bed4617b1a0385087066c93 Jun 06 21:12:21.319208 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-AttachVolumeShelveTestJSON-440411712-project Jun 06 21:12:21.319208 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: > Jun 06 21:12:21.319208 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 could not be found. Jun 06 21:12:21.319208 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'id': '1886e3bf-c735-4f91-8a2f-0bc6996982e0'} Jun 06 21:12:21.320157 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:12:21.320157 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:12:21.320157 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:12:21.320157 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:12:21.320157 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:12:21.320157 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:12:21.320157 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:12:21.320157 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:12:21.320157 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:12:21.320157 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:12:21.320157 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 could not be found. Jun 06 21:12:21.320157 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:12:21.320157 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:12:21.320157 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:12:21.320157 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:12:21.320157 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:12:21.320157 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:12:21.320157 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:12:21.320157 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:12:21.320157 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:12:21.321650 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:12:21.321650 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:12:21.321650 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:12:21.321650 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:12:21.321650 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:12:21.321650 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:12:21.321650 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:12:21.321650 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 could not be found. Jun 06 21:12:21.321650 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:12:21.321650 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:12:21.321650 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:12:21.321650 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:12:21.321650 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:12:21.321650 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:12:21.321650 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:12:21.321650 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:12:21.321650 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 could not be found. Jun 06 21:12:21.321650 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:12:21.322955 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-45dd0808-fe35-45c9-ba9b-21804d03194a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] Returning 404 to user: Instance 1886e3bf-c735-4f91-8a2f-0bc6996982e0 could not be found. {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:12:21.322955 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-45dd0808-fe35-45c9-ba9b-21804d03194a tempest-AttachVolumeShelveTestJSON-440411712 tempest-AttachVolumeShelveTestJSON-440411712-project] 10.222.0.33 "GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0" status: 404 len: 111 microversion: 2.20 time: 0.030799 Jun 06 21:12:21.322955 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 418/876] 10.222.0.33 () {60 vars in 1276 bytes} [Mon Jun 6 21:12:21 2022] GET /compute/v2.1/servers/1886e3bf-c735-4f91-8a2f-0bc6996982e0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 21:12:55.933851 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-be312831-dee5-441e-890a-467276b95030 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:12:55.934506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-be312831-dee5-441e-890a-467276b95030 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:12:55.936778 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:55.937416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:55.942929 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be312831-dee5-441e-890a-467276b95030 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:55.943372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be312831-dee5-441e-890a-467276b95030 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:55.944175 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be312831-dee5-441e-890a-467276b95030 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:55.944589 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-be312831-dee5-441e-890a-467276b95030 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:55.971029 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-be312831-dee5-441e-890a-467276b95030 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f/ips" status: 200 len: 145 microversion: 2.1 time: 0.041349 Jun 06 21:12:55.971566 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 459/877] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jun 6 21:12:55 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:12:59.585756 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b13181df-b190-44e5-9a87-e4f387636fdf tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de036f78-a299-4903-ae53-5b451a23e2b7"}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:12:59.586851 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-b13181df-b190-44e5-9a87-e4f387636fdf tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:12:59.588941 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:59.589640 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=25 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:12:59.596021 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b13181df-b190-44e5-9a87-e4f387636fdf tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:59.596486 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b13181df-b190-44e5-9a87-e4f387636fdf tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:59.597263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b13181df-b190-44e5-9a87-e4f387636fdf tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:12:59.597702 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b13181df-b190-44e5-9a87-e4f387636fdf tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:12:59.865746 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-b13181df-b190-44e5-9a87-e4f387636fdf tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "POST /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283680 Jun 06 21:12:59.871252 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 419/878] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 6 21:12:59 2022] POST /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:13:01.652833 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-64a6c132-5fc9-471a-9d0f-cc138b34591b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:01.654240 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-64a6c132-5fc9-471a-9d0f-cc138b34591b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:01.655706 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-3541be0a-fa8c-4092-ad40-05f939104baf req-474ffd8e-f947-443a-a25f-8a6e1038172d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807baad3-4d23-4d63-b4a9-7163fc77e302", "tag": "98717e19-2897-4922-9eb5-8ca664fad7a8"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:13:01.661923 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-64a6c132-5fc9-471a-9d0f-cc138b34591b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:01.662462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-64a6c132-5fc9-471a-9d0f-cc138b34591b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:01.663331 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-64a6c132-5fc9-471a-9d0f-cc138b34591b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:01.663915 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-64a6c132-5fc9-471a-9d0f-cc138b34591b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:01.666194 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-3541be0a-fa8c-4092-ad40-05f939104baf req-474ffd8e-f947-443a-a25f-8a6e1038172d service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:01.666695 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-3541be0a-fa8c-4092-ad40-05f939104baf req-474ffd8e-f947-443a-a25f-8a6e1038172d service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:01.678785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-3541be0a-fa8c-4092-ad40-05f939104baf req-474ffd8e-f947-443a-a25f-8a6e1038172d service nova] Creating event network-changed:98717e19-2897-4922-9eb5-8ca664fad7a8 for instance 807baad3-4d23-4d63-b4a9-7163fc77e302 on hv-cinder-84488 Jun 06 21:13:01.684186 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-3541be0a-fa8c-4092-ad40-05f939104baf req-474ffd8e-f947-443a-a25f-8a6e1038172d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032882 Jun 06 21:13:01.684799 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 420/879] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:13:01.702524 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-64a6c132-5fc9-471a-9d0f-cc138b34591b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 21:13:01.802431 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-64a6c132-5fc9-471a-9d0f-cc138b34591b tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "DELETE /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 204 len: 0 microversion: 2.1 time: 0.154494 Jun 06 21:13:01.806395 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 460/880] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:13:01 2022] DELETE /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 21:13:01.812263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-25ff5f5d-c448-43cb-b7db-1fb596129830 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:01.813022 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-25ff5f5d-c448-43cb-b7db-1fb596129830 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:01.825669 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-25ff5f5d-c448-43cb-b7db-1fb596129830 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:01.826431 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-25ff5f5d-c448-43cb-b7db-1fb596129830 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:01.827865 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-25ff5f5d-c448-43cb-b7db-1fb596129830 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:01.828567 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-25ff5f5d-c448-43cb-b7db-1fb596129830 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:01.991524 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-25ff5f5d-c448-43cb-b7db-1fb596129830 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:02.002120 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-25ff5f5d-c448-43cb-b7db-1fb596129830 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1567 microversion: 2.1 time: 0.194054 Jun 06 21:13:02.002729 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 421/881] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:01 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1567 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:03.020755 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-39774da5-79bc-4d0c-8a20-a21a2eb65bc0 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:03.021530 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-39774da5-79bc-4d0c-8a20-a21a2eb65bc0 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:03.028098 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-39774da5-79bc-4d0c-8a20-a21a2eb65bc0 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:03.029186 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-39774da5-79bc-4d0c-8a20-a21a2eb65bc0 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:03.030105 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-39774da5-79bc-4d0c-8a20-a21a2eb65bc0 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:03.030716 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-39774da5-79bc-4d0c-8a20-a21a2eb65bc0 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:03.221955 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-39774da5-79bc-4d0c-8a20-a21a2eb65bc0 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:03.230159 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-39774da5-79bc-4d0c-8a20-a21a2eb65bc0 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1567 microversion: 2.1 time: 0.214122 Jun 06 21:13:03.230856 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 461/882] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:03 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1567 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:04.097545 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-0d10e4d9-22c9-4125-a053-87f5a228511a req-2cbcbc52-f15c-449e-b635-9d9f87a29297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807baad3-4d23-4d63-b4a9-7163fc77e302", "name": "network-vif-deleted", "tag": "98717e19-2897-4922-9eb5-8ca664fad7a8"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:13:04.120278 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-0d10e4d9-22c9-4125-a053-87f5a228511a req-2cbcbc52-f15c-449e-b635-9d9f87a29297 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:04.120819 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-0d10e4d9-22c9-4125-a053-87f5a228511a req-2cbcbc52-f15c-449e-b635-9d9f87a29297 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:04.140247 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-0d10e4d9-22c9-4125-a053-87f5a228511a req-2cbcbc52-f15c-449e-b635-9d9f87a29297 service nova] Creating event network-vif-deleted:98717e19-2897-4922-9eb5-8ca664fad7a8 for instance 807baad3-4d23-4d63-b4a9-7163fc77e302 on hv-cinder-84488 Jun 06 21:13:04.145627 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-0d10e4d9-22c9-4125-a053-87f5a228511a req-2cbcbc52-f15c-449e-b635-9d9f87a29297 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052182 Jun 06 21:13:04.146493 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 422/883] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:13:04.249122 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-aa1c2c03-72ac-4192-ab35-6fd249c4c288 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:04.249963 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-aa1c2c03-72ac-4192-ab35-6fd249c4c288 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:04.258199 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aa1c2c03-72ac-4192-ab35-6fd249c4c288 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:04.258661 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aa1c2c03-72ac-4192-ab35-6fd249c4c288 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:04.259514 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aa1c2c03-72ac-4192-ab35-6fd249c4c288 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:04.259940 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aa1c2c03-72ac-4192-ab35-6fd249c4c288 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:04.333595 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-aa1c2c03-72ac-4192-ab35-6fd249c4c288 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36e865c93d844d8aa23661f779cd8e60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a68679e2b3544bbb82f944fcae970ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:04.345112 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-aa1c2c03-72ac-4192-ab35-6fd249c4c288 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 200 len: 1218 microversion: 2.1 time: 0.099983 Jun 06 21:13:04.346306 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 462/884] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:04 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 1218 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:05.370609 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-695db976-5e9c-4e15-81da-4ca8ce492773 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:05.371300 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-695db976-5e9c-4e15-81da-4ca8ce492773 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] [instance: 807baad3-4d23-4d63-b4a9-7163fc77e302] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:05.378859 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-695db976-5e9c-4e15-81da-4ca8ce492773 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:05.379294 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-695db976-5e9c-4e15-81da-4ca8ce492773 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:05.380127 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-695db976-5e9c-4e15-81da-4ca8ce492773 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:05.380556 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-695db976-5e9c-4e15-81da-4ca8ce492773 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:05.394062 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-695db976-5e9c-4e15-81da-4ca8ce492773 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] HTTP exception thrown: Instance 807baad3-4d23-4d63-b4a9-7163fc77e302 could not be found. Jun 06 21:13:05.395682 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-695db976-5e9c-4e15-81da-4ca8ce492773 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Request method failure captured: Jun 06 21:13:05.395682 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 HTTP/1.1 Jun 06 21:13:05.395682 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:13:05.395682 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:13:05.395682 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:13:05.395682 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 0 Jun 06 21:13:05.395682 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:13:05.395682 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:13:05.395682 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:13:05.395682 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:13:05.395682 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinmyJPJfi7AnbLzH-ZJmVE5rHjbWmuu_CRcN6_HmvlOMZ6A1syhQNgF5i2qWGQ-VGd5u4eDUmzqZVC9sNwve_xOALwf84SxhsVKu8TC4muqWYh4tmPcZwQlENg3-hBHbyWIuUzOw1-Ut9CknYQUQkWYtujDunidq7H1WwhFk_vt_njYg Jun 06 21:13:05.395682 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:13:05.395682 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:13:05.395682 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:13:05.395682 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:13:05.395682 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:13:05.395682 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:13:05.395682 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: 5a68679e2b3544bbb82f944fcae970ef Jun 06 21:13:05.395682 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-TestShelveInstance-1600093374 Jun 06 21:13:05.395682 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:13:05.395682 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:13:05.397398 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a68679e2b3544bbb82f944fcae970ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_5a68679e2b3544bbb82f944fcae970ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/5a68679e2b3544bbb82f944fcae970ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/5a68679e2b3544bbb82f944fcae970ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:13:05.397398 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-TestShelveInstance-1600093374 Jun 06 21:13:05.397398 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: 5a68679e2b3544bbb82f944fcae970ef Jun 06 21:13:05.397398 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-TestShelveInstance-1600093374 Jun 06 21:13:05.397398 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-TestShelveInstance-1600093374-project Jun 06 21:13:05.397398 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:13:05.397398 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:13:05.397398 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: 36e865c93d844d8aa23661f779cd8e60 Jun 06 21:13:05.397398 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-TestShelveInstance-1600093374-project Jun 06 21:13:05.397398 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: > Jun 06 21:13:05.397398 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Instance 807baad3-4d23-4d63-b4a9-7163fc77e302 could not be found. Jun 06 21:13:05.397398 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'id': '807baad3-4d23-4d63-b4a9-7163fc77e302'} Jun 06 21:13:05.398371 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:13:05.398371 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:13:05.398371 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:13:05.398371 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:13:05.398371 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:13:05.398371 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:13:05.398371 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:13:05.398371 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:13:05.398371 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:13:05.398371 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:13:05.398371 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 807baad3-4d23-4d63-b4a9-7163fc77e302 could not be found. Jun 06 21:13:05.398371 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:13:05.398371 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:13:05.398371 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:13:05.398371 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:13:05.398371 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:13:05.398371 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:13:05.398371 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:13:05.398371 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:13:05.398371 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:13:05.399977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:13:05.399977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:13:05.399977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:13:05.399977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:13:05.399977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:13:05.399977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:13:05.399977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:13:05.399977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 807baad3-4d23-4d63-b4a9-7163fc77e302 could not be found. Jun 06 21:13:05.399977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:13:05.399977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:13:05.399977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:13:05.399977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:13:05.399977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:13:05.399977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:13:05.399977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:13:05.399977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:13:05.399977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 807baad3-4d23-4d63-b4a9-7163fc77e302 could not be found. Jun 06 21:13:05.399977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:13:05.401394 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-695db976-5e9c-4e15-81da-4ca8ce492773 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Returning 404 to user: Instance 807baad3-4d23-4d63-b4a9-7163fc77e302 could not be found. {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:13:05.401394 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-695db976-5e9c-4e15-81da-4ca8ce492773 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302" status: 404 len: 111 microversion: 2.1 time: 0.031039 Jun 06 21:13:05.401394 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 423/885] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:05 2022] GET /compute/v2.1/servers/807baad3-4d23-4d63-b4a9-7163fc77e302 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:13:05.585276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-21e61ca0-da9c-4f7f-bb8d-ad343c5ef436 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] Calling method '.version_select at 0x7f27257bcdc0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:05.621389 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-21e61ca0-da9c-4f7f-bb8d-ad343c5ef436 tempest-TestShelveInstance-1600093374 tempest-TestShelveInstance-1600093374-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-408149276" status: 202 len: 0 microversion: 2.1 time: 0.041690 Jun 06 21:13:05.622511 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 463/886] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jun 6 21:13:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-408149276 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:13:09.571524 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-4606fe0a-3311-465c-a68c-6cb05089c72b tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:13:09.579751 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4606fe0a-3311-465c-a68c-6cb05089c72b tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:09.580727 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4606fe0a-3311-465c-a68c-6cb05089c72b tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:09.644209 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-4606fe0a-3311-465c-a68c-6cb05089c72b tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Going to try to stop instance {{(pid=117860) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 06 21:13:09.692603 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-4606fe0a-3311-465c-a68c-6cb05089c72b tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "POST /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f/action" status: 202 len: 0 microversion: 2.1 time: 0.124544 Jun 06 21:13:09.693214 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 424/887] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 6 21:13:09 2022] POST /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:13:09.702924 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-dfd04a8b-07fd-4af0-83e3-4f39c1ee97ae tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:09.703456 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-dfd04a8b-07fd-4af0-83e3-4f39c1ee97ae tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:09.711532 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dfd04a8b-07fd-4af0-83e3-4f39c1ee97ae tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:09.711983 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dfd04a8b-07fd-4af0-83e3-4f39c1ee97ae tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:09.713106 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dfd04a8b-07fd-4af0-83e3-4f39c1ee97ae tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:09.713885 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dfd04a8b-07fd-4af0-83e3-4f39c1ee97ae tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:09.948762 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-dfd04a8b-07fd-4af0-83e3-4f39c1ee97ae tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:09.964391 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-dfd04a8b-07fd-4af0-83e3-4f39c1ee97ae tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1723 microversion: 2.1 time: 0.265974 Jun 06 21:13:09.965351 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 464/888] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:09 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:13:10.983420 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-a2dfc41d-9cbc-46bf-a480-808f5da4e82f tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:10.984352 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-a2dfc41d-9cbc-46bf-a480-808f5da4e82f tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:10.991816 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a2dfc41d-9cbc-46bf-a480-808f5da4e82f tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:10.992721 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a2dfc41d-9cbc-46bf-a480-808f5da4e82f tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:10.993612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a2dfc41d-9cbc-46bf-a480-808f5da4e82f tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:10.994226 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-a2dfc41d-9cbc-46bf-a480-808f5da4e82f tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:11.225212 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-a2dfc41d-9cbc-46bf-a480-808f5da4e82f tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:11.234777 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-a2dfc41d-9cbc-46bf-a480-808f5da4e82f tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1723 microversion: 2.1 time: 0.256425 Jun 06 21:13:11.236658 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 425/889] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:10 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:12.252415 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6ab71697-8ec1-429b-a2b8-189adcd2af1a tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:12.253562 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6ab71697-8ec1-429b-a2b8-189adcd2af1a tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:12.261542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ab71697-8ec1-429b-a2b8-189adcd2af1a tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:12.261957 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ab71697-8ec1-429b-a2b8-189adcd2af1a tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:12.262906 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ab71697-8ec1-429b-a2b8-189adcd2af1a tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:12.263304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6ab71697-8ec1-429b-a2b8-189adcd2af1a tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:12.463129 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6ab71697-8ec1-429b-a2b8-189adcd2af1a tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:12.482964 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6ab71697-8ec1-429b-a2b8-189adcd2af1a tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1723 microversion: 2.1 time: 0.234946 Jun 06 21:13:12.484372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 465/890] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:12 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:13.500229 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e537d8f3-b296-4a21-8781-f167986a4ec7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:13.500876 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-e537d8f3-b296-4a21-8781-f167986a4ec7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:13.507716 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e537d8f3-b296-4a21-8781-f167986a4ec7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:13.508218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e537d8f3-b296-4a21-8781-f167986a4ec7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:13.509024 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e537d8f3-b296-4a21-8781-f167986a4ec7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:13.509455 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e537d8f3-b296-4a21-8781-f167986a4ec7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:13.709379 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e537d8f3-b296-4a21-8781-f167986a4ec7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:13.719144 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-e537d8f3-b296-4a21-8781-f167986a4ec7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1723 microversion: 2.1 time: 0.222653 Jun 06 21:13:13.719832 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 426/891] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:13 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:14.737264 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8c621ecd-1260-4067-a8de-0091c84fd767 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:14.737827 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8c621ecd-1260-4067-a8de-0091c84fd767 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:14.744885 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8c621ecd-1260-4067-a8de-0091c84fd767 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:14.745332 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8c621ecd-1260-4067-a8de-0091c84fd767 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:14.746088 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8c621ecd-1260-4067-a8de-0091c84fd767 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:14.746518 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8c621ecd-1260-4067-a8de-0091c84fd767 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:14.896739 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8c621ecd-1260-4067-a8de-0091c84fd767 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:14.905245 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8c621ecd-1260-4067-a8de-0091c84fd767 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1723 microversion: 2.1 time: 0.172066 Jun 06 21:13:14.905816 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 466/892] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:14 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:15.923923 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0a195282-0a1a-4e27-984b-2e7fcd8b76a3 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:15.924579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-0a195282-0a1a-4e27-984b-2e7fcd8b76a3 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:15.931885 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0a195282-0a1a-4e27-984b-2e7fcd8b76a3 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:15.932356 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0a195282-0a1a-4e27-984b-2e7fcd8b76a3 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:15.933106 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0a195282-0a1a-4e27-984b-2e7fcd8b76a3 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:15.933524 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0a195282-0a1a-4e27-984b-2e7fcd8b76a3 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:16.085205 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-0a195282-0a1a-4e27-984b-2e7fcd8b76a3 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:16.097971 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-0a195282-0a1a-4e27-984b-2e7fcd8b76a3 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1723 microversion: 2.1 time: 0.178065 Jun 06 21:13:16.098858 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 427/893] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:15 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:17.119871 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1a27ebb8-1f0d-4de7-94fc-9c0bf204a451 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:17.120829 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1a27ebb8-1f0d-4de7-94fc-9c0bf204a451 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:17.128759 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a27ebb8-1f0d-4de7-94fc-9c0bf204a451 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:17.129290 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a27ebb8-1f0d-4de7-94fc-9c0bf204a451 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:17.130186 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a27ebb8-1f0d-4de7-94fc-9c0bf204a451 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:17.130694 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a27ebb8-1f0d-4de7-94fc-9c0bf204a451 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:17.268433 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-1a27ebb8-1f0d-4de7-94fc-9c0bf204a451 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:17.276981 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1a27ebb8-1f0d-4de7-94fc-9c0bf204a451 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1723 microversion: 2.1 time: 0.161130 Jun 06 21:13:17.277646 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 467/894] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:17 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:18.294956 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-9c17c0fc-59af-4e1e-8bc0-ce00ca7162c5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:18.295556 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-9c17c0fc-59af-4e1e-8bc0-ce00ca7162c5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:18.302970 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9c17c0fc-59af-4e1e-8bc0-ce00ca7162c5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:18.303420 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9c17c0fc-59af-4e1e-8bc0-ce00ca7162c5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:18.304244 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9c17c0fc-59af-4e1e-8bc0-ce00ca7162c5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:18.305518 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9c17c0fc-59af-4e1e-8bc0-ce00ca7162c5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:18.450489 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-9c17c0fc-59af-4e1e-8bc0-ce00ca7162c5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:18.462255 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-9c17c0fc-59af-4e1e-8bc0-ce00ca7162c5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1723 microversion: 2.1 time: 0.171016 Jun 06 21:13:18.463271 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 428/895] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:18 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:19.484736 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d5de5046-a0b0-4504-9471-8bcd56959f77 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:19.485419 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d5de5046-a0b0-4504-9471-8bcd56959f77 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:19.493452 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d5de5046-a0b0-4504-9471-8bcd56959f77 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:19.493892 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d5de5046-a0b0-4504-9471-8bcd56959f77 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:19.494866 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d5de5046-a0b0-4504-9471-8bcd56959f77 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:19.495310 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d5de5046-a0b0-4504-9471-8bcd56959f77 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:19.646133 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d5de5046-a0b0-4504-9471-8bcd56959f77 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:19.654388 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d5de5046-a0b0-4504-9471-8bcd56959f77 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1723 microversion: 2.1 time: 0.174323 Jun 06 21:13:19.654963 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 468/896] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:19 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:20.672883 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-6fab1c10-4527-494e-a780-496a40dd6c2c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:20.673435 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-6fab1c10-4527-494e-a780-496a40dd6c2c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:20.681224 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6fab1c10-4527-494e-a780-496a40dd6c2c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:20.681674 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6fab1c10-4527-494e-a780-496a40dd6c2c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:20.682432 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6fab1c10-4527-494e-a780-496a40dd6c2c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:20.682864 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6fab1c10-4527-494e-a780-496a40dd6c2c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:20.826618 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-6fab1c10-4527-494e-a780-496a40dd6c2c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:20.835873 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-6fab1c10-4527-494e-a780-496a40dd6c2c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1723 microversion: 2.1 time: 0.166952 Jun 06 21:13:20.836480 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 429/897] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:20 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:21.853508 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8bf75ddc-4b25-4dd2-ad76-da23f720953d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:21.854094 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8bf75ddc-4b25-4dd2-ad76-da23f720953d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:21.861329 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8bf75ddc-4b25-4dd2-ad76-da23f720953d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:21.861781 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8bf75ddc-4b25-4dd2-ad76-da23f720953d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:21.862544 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8bf75ddc-4b25-4dd2-ad76-da23f720953d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:21.862943 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8bf75ddc-4b25-4dd2-ad76-da23f720953d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:22.001691 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-8bf75ddc-4b25-4dd2-ad76-da23f720953d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:22.010185 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8bf75ddc-4b25-4dd2-ad76-da23f720953d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1723 microversion: 2.1 time: 0.160649 Jun 06 21:13:22.010761 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 469/898] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:21 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:23.031491 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-984e4772-2c2b-41a3-9413-d45c59efed55 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:23.032271 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-984e4772-2c2b-41a3-9413-d45c59efed55 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:23.042618 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-984e4772-2c2b-41a3-9413-d45c59efed55 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:23.042618 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-984e4772-2c2b-41a3-9413-d45c59efed55 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:23.043247 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-984e4772-2c2b-41a3-9413-d45c59efed55 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:23.043727 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-984e4772-2c2b-41a3-9413-d45c59efed55 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:23.187817 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-984e4772-2c2b-41a3-9413-d45c59efed55 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:23.195983 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-984e4772-2c2b-41a3-9413-d45c59efed55 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1723 microversion: 2.1 time: 0.170968 Jun 06 21:13:23.196582 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 430/899] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:23 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:24.214226 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-526f1c6c-c53c-45c8-9011-3502337f5e2e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:24.214803 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-526f1c6c-c53c-45c8-9011-3502337f5e2e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:24.221644 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-526f1c6c-c53c-45c8-9011-3502337f5e2e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:24.222095 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-526f1c6c-c53c-45c8-9011-3502337f5e2e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:24.222850 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-526f1c6c-c53c-45c8-9011-3502337f5e2e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:24.223308 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-526f1c6c-c53c-45c8-9011-3502337f5e2e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:24.367353 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-526f1c6c-c53c-45c8-9011-3502337f5e2e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:24.379147 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-526f1c6c-c53c-45c8-9011-3502337f5e2e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1723 microversion: 2.1 time: 0.168837 Jun 06 21:13:24.379900 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 470/900] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:24 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:25.398805 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-8d958a2a-bbef-4fd2-b649-9f7211e6775d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:25.399367 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-8d958a2a-bbef-4fd2-b649-9f7211e6775d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:25.407452 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8d958a2a-bbef-4fd2-b649-9f7211e6775d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:25.407739 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8d958a2a-bbef-4fd2-b649-9f7211e6775d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:25.408822 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8d958a2a-bbef-4fd2-b649-9f7211e6775d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:25.409367 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8d958a2a-bbef-4fd2-b649-9f7211e6775d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:25.554699 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-8d958a2a-bbef-4fd2-b649-9f7211e6775d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:25.562960 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-8d958a2a-bbef-4fd2-b649-9f7211e6775d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1723 microversion: 2.1 time: 0.169841 Jun 06 21:13:25.563524 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 431/901] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:25 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:26.580658 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-501fa617-ea57-4860-9cb7-5bdb8bfdfd06 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:26.581471 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-501fa617-ea57-4860-9cb7-5bdb8bfdfd06 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:26.588887 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:26.595702 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-501fa617-ea57-4860-9cb7-5bdb8bfdfd06 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:26.596359 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-501fa617-ea57-4860-9cb7-5bdb8bfdfd06 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:26.597227 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-501fa617-ea57-4860-9cb7-5bdb8bfdfd06 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:26.597723 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-501fa617-ea57-4860-9cb7-5bdb8bfdfd06 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:26.602082 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:26.742376 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-501fa617-ea57-4860-9cb7-5bdb8bfdfd06 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:26.752580 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-501fa617-ea57-4860-9cb7-5bdb8bfdfd06 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1723 microversion: 2.1 time: 0.176318 Jun 06 21:13:26.753165 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 471/902] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:26 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:27.769577 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-1deb20f9-1702-4e0a-be4e-4e33e9e46be5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:27.770686 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-1deb20f9-1702-4e0a-be4e-4e33e9e46be5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:27.778985 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1deb20f9-1702-4e0a-be4e-4e33e9e46be5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:27.779713 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1deb20f9-1702-4e0a-be4e-4e33e9e46be5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:27.780690 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1deb20f9-1702-4e0a-be4e-4e33e9e46be5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:27.781109 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1deb20f9-1702-4e0a-be4e-4e33e9e46be5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:27.934874 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-1deb20f9-1702-4e0a-be4e-4e33e9e46be5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:27.944766 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-1deb20f9-1702-4e0a-be4e-4e33e9e46be5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1723 microversion: 2.1 time: 0.179303 Jun 06 21:13:27.945348 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 432/903] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:27 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:28.963521 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-48b006c4-0781-41d1-9f23-184a20d24d6e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:28.964089 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-48b006c4-0781-41d1-9f23-184a20d24d6e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:28.971291 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-48b006c4-0781-41d1-9f23-184a20d24d6e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:28.971739 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-48b006c4-0781-41d1-9f23-184a20d24d6e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:28.972584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-48b006c4-0781-41d1-9f23-184a20d24d6e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:28.973017 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-48b006c4-0781-41d1-9f23-184a20d24d6e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:29.119552 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-48b006c4-0781-41d1-9f23-184a20d24d6e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:29.127703 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-48b006c4-0781-41d1-9f23-184a20d24d6e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1723 microversion: 2.1 time: 0.168656 Jun 06 21:13:29.128278 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 472/904] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:28 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:30.145081 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-95106d9f-275b-4485-b369-f401207ff0fc tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:30.145705 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-95106d9f-275b-4485-b369-f401207ff0fc tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:30.148427 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=29 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:30.153962 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-95106d9f-275b-4485-b369-f401207ff0fc tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:30.154409 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-95106d9f-275b-4485-b369-f401207ff0fc tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:30.155180 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-95106d9f-275b-4485-b369-f401207ff0fc tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:30.155614 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-95106d9f-275b-4485-b369-f401207ff0fc tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:30.158503 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:30.314333 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-95106d9f-275b-4485-b369-f401207ff0fc tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:30.323018 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-95106d9f-275b-4485-b369-f401207ff0fc tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1723 microversion: 2.1 time: 0.181862 Jun 06 21:13:30.323592 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 433/905] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:30 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:31.341433 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-df59b09a-6ffb-4608-8bb5-717af1be5f5c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:31.342013 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-df59b09a-6ffb-4608-8bb5-717af1be5f5c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:31.348995 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-df59b09a-6ffb-4608-8bb5-717af1be5f5c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:31.349471 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-df59b09a-6ffb-4608-8bb5-717af1be5f5c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:31.350395 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-df59b09a-6ffb-4608-8bb5-717af1be5f5c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:31.351239 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-df59b09a-6ffb-4608-8bb5-717af1be5f5c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:31.489127 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-df59b09a-6ffb-4608-8bb5-717af1be5f5c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:31.509294 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-df59b09a-6ffb-4608-8bb5-717af1be5f5c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1700 microversion: 2.1 time: 0.171729 Jun 06 21:13:31.509953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 473/906] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:31 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1700 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:31.527384 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b3c8a6a7-6a1d-4857-bfa3-0c0fdac61eaa tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:13:31.534405 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b3c8a6a7-6a1d-4857-bfa3-0c0fdac61eaa tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:31.534867 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b3c8a6a7-6a1d-4857-bfa3-0c0fdac61eaa tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:31.557605 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-b3c8a6a7-6a1d-4857-bfa3-0c0fdac61eaa tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Going to try to start instance {{(pid=117860) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 06 21:13:31.609811 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-b3c8a6a7-6a1d-4857-bfa3-0c0fdac61eaa tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "POST /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f/action" status: 202 len: 0 microversion: 2.1 time: 0.085793 Jun 06 21:13:31.610756 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 434/907] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 6 21:13:31 2022] POST /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:13:31.621168 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a5660041-ca1d-4706-b514-1fedbcca3247 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:31.621770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a5660041-ca1d-4706-b514-1fedbcca3247 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:31.628940 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a5660041-ca1d-4706-b514-1fedbcca3247 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:31.629647 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a5660041-ca1d-4706-b514-1fedbcca3247 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:31.630776 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a5660041-ca1d-4706-b514-1fedbcca3247 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:31.631482 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a5660041-ca1d-4706-b514-1fedbcca3247 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:31.778084 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a5660041-ca1d-4706-b514-1fedbcca3247 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:31.786357 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a5660041-ca1d-4706-b514-1fedbcca3247 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1709 microversion: 2.1 time: 0.169192 Jun 06 21:13:31.786984 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 474/908] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:31 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1709 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:32.807145 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-7db0dc74-96fc-4dfe-a966-82e56c7f667c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:32.807867 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-7db0dc74-96fc-4dfe-a966-82e56c7f667c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:32.816019 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7db0dc74-96fc-4dfe-a966-82e56c7f667c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:32.816494 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7db0dc74-96fc-4dfe-a966-82e56c7f667c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:32.817271 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7db0dc74-96fc-4dfe-a966-82e56c7f667c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:32.817702 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7db0dc74-96fc-4dfe-a966-82e56c7f667c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:32.957165 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-7db0dc74-96fc-4dfe-a966-82e56c7f667c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:32.965778 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-7db0dc74-96fc-4dfe-a966-82e56c7f667c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1709 microversion: 2.1 time: 0.164645 Jun 06 21:13:32.966359 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 435/909] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:32 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1709 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:33.983668 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d910b32f-68c4-45f6-bea6-1c7cc58af9a7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:33.984327 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d910b32f-68c4-45f6-bea6-1c7cc58af9a7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:33.991471 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d910b32f-68c4-45f6-bea6-1c7cc58af9a7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:33.991912 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d910b32f-68c4-45f6-bea6-1c7cc58af9a7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:33.992709 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d910b32f-68c4-45f6-bea6-1c7cc58af9a7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:33.993135 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d910b32f-68c4-45f6-bea6-1c7cc58af9a7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:34.139791 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d910b32f-68c4-45f6-bea6-1c7cc58af9a7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:34.148935 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d910b32f-68c4-45f6-bea6-1c7cc58af9a7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1709 microversion: 2.1 time: 0.169113 Jun 06 21:13:34.149523 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 475/910] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:33 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1709 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:35.166986 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0f58ce60-0f36-449e-8161-72a5f554380b tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:35.167610 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-0f58ce60-0f36-449e-8161-72a5f554380b tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:35.174757 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0f58ce60-0f36-449e-8161-72a5f554380b tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:35.175201 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0f58ce60-0f36-449e-8161-72a5f554380b tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:35.176034 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0f58ce60-0f36-449e-8161-72a5f554380b tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:35.176504 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0f58ce60-0f36-449e-8161-72a5f554380b tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:35.347649 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-0f58ce60-0f36-449e-8161-72a5f554380b tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:35.356636 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-0f58ce60-0f36-449e-8161-72a5f554380b tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1709 microversion: 2.1 time: 0.194396 Jun 06 21:13:35.357225 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 436/911] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:35 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1709 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:36.374977 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-829e4a60-c58c-4503-8e8e-ae324581e567 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:36.375688 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-829e4a60-c58c-4503-8e8e-ae324581e567 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:36.382958 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-829e4a60-c58c-4503-8e8e-ae324581e567 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:36.383413 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-829e4a60-c58c-4503-8e8e-ae324581e567 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:36.384262 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-829e4a60-c58c-4503-8e8e-ae324581e567 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:36.384693 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-829e4a60-c58c-4503-8e8e-ae324581e567 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:36.532249 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-829e4a60-c58c-4503-8e8e-ae324581e567 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:36.540496 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-829e4a60-c58c-4503-8e8e-ae324581e567 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1713 microversion: 2.1 time: 0.169413 Jun 06 21:13:36.541073 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 476/912] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:36 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1713 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:13:58.492366 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-976ed54f-9db4-4da7-b080-026ff542a867 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Action: 'create', calling method: .version_select at 0x7f2725f5fdc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1641621869", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEUhLoJOUF1w3g2w/qe7cH1FV0N9HWmR2pPYb82S64dYkvMebLfWFLlC9HCsfvjvx5aEQtH15l4sGK/XH12G7mLch8+M9wPEVAr1BcejWiDEOHVAmeBhl3fDuaf7noQ8Eg=="}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:13:58.496916 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=7 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:58.497575 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:58.512181 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-976ed54f-9db4-4da7-b080-026ff542a867 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Getting quotas for project d768129e58ea4e4bb4cb2da9a11da521. Resources: {'key_pairs'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:13:58.516839 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-976ed54f-9db4-4da7-b080-026ff542a867 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Getting quotas for user 941d5887422e439a8196fc8b38c3f890 and project d768129e58ea4e4bb4cb2da9a11da521. Resources: {'key_pairs'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:13:58.561814 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-976ed54f-9db4-4da7-b080-026ff542a867 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.060097 Jun 06 21:13:58.561814 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 437/913] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jun 6 21:13:58 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:13:58.608409 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-8d583fc4-8890-4b4f-988a-a74533428897 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1748210863", "imageRef": "65d9fec9-edbc-416e-a2ea-bcbc66fd7df1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1641621869", "networks": [{"uuid": "9286759e-77e6-4fb5-9a43-36f011ab732e"}]}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:13:58.615290 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=11 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:58.616155 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=35 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:13:58.666162 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-8d583fc4-8890-4b4f-988a-a74533428897 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] validate_networks() for [('9286759e-77e6-4fb5-9a43-36f011ab732e', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 21:13:59.056401 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-8d583fc4-8890-4b4f-988a-a74533428897 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 21:13:59.056836 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-8d583fc4-8890-4b4f-988a-a74533428897 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 21:13:59.057303 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-8d583fc4-8890-4b4f-988a-a74533428897 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 21:13:59.057700 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-8d583fc4-8890-4b4f-988a-a74533428897 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 21:13:59.058127 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-8d583fc4-8890-4b4f-988a-a74533428897 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 21:13:59.067238 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d583fc4-8890-4b4f-988a-a74533428897 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:59.067681 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d583fc4-8890-4b4f-988a-a74533428897 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:59.068503 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d583fc4-8890-4b4f-988a-a74533428897 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:13:59.068905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-8d583fc4-8890-4b4f-988a-a74533428897 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:13:59.086334 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-8d583fc4-8890-4b4f-988a-a74533428897 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Getting quotas for project d768129e58ea4e4bb4cb2da9a11da521. Resources: {'ram', 'cores', 'instances'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:13:59.090706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-8d583fc4-8890-4b4f-988a-a74533428897 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Getting quotas for user 941d5887422e439a8196fc8b38c3f890 and project d768129e58ea4e4bb4cb2da9a11da521. Resources: {'ram', 'cores', 'instances'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:13:59.101561 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8d583fc4-8890-4b4f-988a-a74533428897 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 21:13:59.103802 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-8d583fc4-8890-4b4f-988a-a74533428897 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='65d9fec9-edbc-416e-a2ea-bcbc66fd7df1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 21:13:59.154740 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-8d583fc4-8890-4b4f-988a-a74533428897 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.550332 Jun 06 21:13:59.155693 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 477/914] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 6 21:13:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 21:13:59.166053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e00f24d0-a523-4444-bcc0-8e1291095d81 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:13:59.166722 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-e00f24d0-a523-4444-bcc0-8e1291095d81 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:13:59.226921 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e00f24d0-a523-4444-bcc0-8e1291095d81 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:13:59.233862 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-e00f24d0-a523-4444-bcc0-8e1291095d81 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1259 microversion: 2.1 time: 0.072012 Jun 06 21:13:59.234419 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 438/915] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:13:59 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:00.253679 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-cf03d63a-1620-4a6a-aaa2-b153a2cc7ad5 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:00.254260 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-cf03d63a-1620-4a6a-aaa2-b153a2cc7ad5 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:00.265202 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf03d63a-1620-4a6a-aaa2-b153a2cc7ad5 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:00.265652 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf03d63a-1620-4a6a-aaa2-b153a2cc7ad5 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:00.266440 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf03d63a-1620-4a6a-aaa2-b153a2cc7ad5 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:00.266904 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-cf03d63a-1620-4a6a-aaa2-b153a2cc7ad5 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:00.337972 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-cf03d63a-1620-4a6a-aaa2-b153a2cc7ad5 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:00.346410 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-cf03d63a-1620-4a6a-aaa2-b153a2cc7ad5 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1329 microversion: 2.1 time: 0.098003 Jun 06 21:14:00.347005 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 478/916] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:00 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1329 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:01.364908 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-44212e3b-aef6-48f2-978e-190dbc7269ad tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:01.365481 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-44212e3b-aef6-48f2-978e-190dbc7269ad tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:01.376432 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-44212e3b-aef6-48f2-978e-190dbc7269ad tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:01.376432 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-44212e3b-aef6-48f2-978e-190dbc7269ad tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:01.376432 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-44212e3b-aef6-48f2-978e-190dbc7269ad tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:01.376432 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-44212e3b-aef6-48f2-978e-190dbc7269ad tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:01.533197 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-44212e3b-aef6-48f2-978e-190dbc7269ad tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:01.541792 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-44212e3b-aef6-48f2-978e-190dbc7269ad tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1359 microversion: 2.1 time: 0.180984 Jun 06 21:14:01.542713 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 439/917] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:01 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:02.565414 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-3dc97876-ab9a-49db-be88-71cc64883a71 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:02.567457 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-3dc97876-ab9a-49db-be88-71cc64883a71 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:02.583043 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3dc97876-ab9a-49db-be88-71cc64883a71 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:02.584289 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3dc97876-ab9a-49db-be88-71cc64883a71 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:02.585910 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3dc97876-ab9a-49db-be88-71cc64883a71 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:02.586903 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-3dc97876-ab9a-49db-be88-71cc64883a71 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:02.735567 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-3dc97876-ab9a-49db-be88-71cc64883a71 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:02.746334 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-3dc97876-ab9a-49db-be88-71cc64883a71 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1359 microversion: 2.1 time: 0.188658 Jun 06 21:14:02.753741 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 479/918] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:02 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1359 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:03.763535 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-50a88df9-0aff-4767-be32-3236a8642aaa tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:03.764229 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-50a88df9-0aff-4767-be32-3236a8642aaa tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:03.771592 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-50a88df9-0aff-4767-be32-3236a8642aaa tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:03.772021 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-50a88df9-0aff-4767-be32-3236a8642aaa tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:03.773579 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-50a88df9-0aff-4767-be32-3236a8642aaa tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:03.774007 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-50a88df9-0aff-4767-be32-3236a8642aaa tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:03.927630 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-50a88df9-0aff-4767-be32-3236a8642aaa tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:03.936137 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-50a88df9-0aff-4767-be32-3236a8642aaa tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1359 microversion: 2.1 time: 0.176419 Jun 06 21:14:03.936729 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 440/919] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:03 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:04.953918 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-87d5fa23-30b4-4ef3-a501-0f611df87e55 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:04.954577 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-87d5fa23-30b4-4ef3-a501-0f611df87e55 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:04.962005 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-87d5fa23-30b4-4ef3-a501-0f611df87e55 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:04.962456 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-87d5fa23-30b4-4ef3-a501-0f611df87e55 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:04.963418 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-87d5fa23-30b4-4ef3-a501-0f611df87e55 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:04.963875 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-87d5fa23-30b4-4ef3-a501-0f611df87e55 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:05.130167 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-87d5fa23-30b4-4ef3-a501-0f611df87e55 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:05.138686 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-87d5fa23-30b4-4ef3-a501-0f611df87e55 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1359 microversion: 2.1 time: 0.189075 Jun 06 21:14:05.149114 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 480/920] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:04 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:06.156876 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-61224cdc-5b32-4345-b686-6b0bd1d929be tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:06.157494 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-61224cdc-5b32-4345-b686-6b0bd1d929be tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:06.165196 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-61224cdc-5b32-4345-b686-6b0bd1d929be tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:06.165555 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-61224cdc-5b32-4345-b686-6b0bd1d929be tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:06.166377 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-61224cdc-5b32-4345-b686-6b0bd1d929be tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:06.166822 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-61224cdc-5b32-4345-b686-6b0bd1d929be tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:06.340644 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-61224cdc-5b32-4345-b686-6b0bd1d929be tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:06.348865 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-61224cdc-5b32-4345-b686-6b0bd1d929be tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1359 microversion: 2.1 time: 0.196065 Jun 06 21:14:06.349480 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 441/921] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:06 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:07.367011 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-361c825e-b54a-4eae-b1df-43fa60a415be tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:07.367630 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-361c825e-b54a-4eae-b1df-43fa60a415be tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:07.374753 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-361c825e-b54a-4eae-b1df-43fa60a415be tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:07.375220 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-361c825e-b54a-4eae-b1df-43fa60a415be tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:07.375982 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-361c825e-b54a-4eae-b1df-43fa60a415be tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:07.376444 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-361c825e-b54a-4eae-b1df-43fa60a415be tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:07.541599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-361c825e-b54a-4eae-b1df-43fa60a415be tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:07.555889 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-361c825e-b54a-4eae-b1df-43fa60a415be tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1359 microversion: 2.1 time: 0.192783 Jun 06 21:14:07.556728 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 481/922] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:07 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1359 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:08.573842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-8de66f40-1ccd-4ec8-baf3-fc1586b83010 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:08.574530 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-8de66f40-1ccd-4ec8-baf3-fc1586b83010 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:08.581725 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8de66f40-1ccd-4ec8-baf3-fc1586b83010 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:08.582160 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8de66f40-1ccd-4ec8-baf3-fc1586b83010 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:08.582915 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8de66f40-1ccd-4ec8-baf3-fc1586b83010 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:08.583337 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8de66f40-1ccd-4ec8-baf3-fc1586b83010 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:08.789995 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-8de66f40-1ccd-4ec8-baf3-fc1586b83010 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:08.798773 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-8de66f40-1ccd-4ec8-baf3-fc1586b83010 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1359 microversion: 2.1 time: 0.228984 Jun 06 21:14:08.800083 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 442/923] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:08 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:09.105952 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-57c251a3-e251-400f-b491-f15b8b19144c req-53d71aba-a518-4261-82f3-774e86f6b2c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7fe5e83-abc4-4dd8-b0db-8360ba722887", "tag": "38f344f4-4c2f-4d38-874b-72005dc25e05"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:14:09.112890 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:14:09.113523 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=6 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:14:09.120659 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-57c251a3-e251-400f-b491-f15b8b19144c req-53d71aba-a518-4261-82f3-774e86f6b2c0 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:09.121134 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-57c251a3-e251-400f-b491-f15b8b19144c req-53d71aba-a518-4261-82f3-774e86f6b2c0 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:09.141833 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-57c251a3-e251-400f-b491-f15b8b19144c req-53d71aba-a518-4261-82f3-774e86f6b2c0 service nova] Creating event network-changed:38f344f4-4c2f-4d38-874b-72005dc25e05 for instance d7fe5e83-abc4-4dd8-b0db-8360ba722887 on hv-cinder-84488 Jun 06 21:14:09.152462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-57c251a3-e251-400f-b491-f15b8b19144c req-53d71aba-a518-4261-82f3-774e86f6b2c0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058514 Jun 06 21:14:09.153489 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 482/924] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:14:09.816763 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-f70206bf-3f6a-46d5-bc71-610399a23763 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:09.817386 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-f70206bf-3f6a-46d5-bc71-610399a23763 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:09.819330 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=6 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:14:09.825581 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f70206bf-3f6a-46d5-bc71-610399a23763 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:09.826025 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f70206bf-3f6a-46d5-bc71-610399a23763 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:09.826786 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f70206bf-3f6a-46d5-bc71-610399a23763 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:09.827537 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f70206bf-3f6a-46d5-bc71-610399a23763 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:09.986657 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-f70206bf-3f6a-46d5-bc71-610399a23763 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:09.996090 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-f70206bf-3f6a-46d5-bc71-610399a23763 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1359 microversion: 2.1 time: 0.183203 Jun 06 21:14:09.996677 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 443/925] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:09 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:11.018113 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c7c8a1b6-bd0f-43c1-915d-0fdfb4249287 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:11.019035 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c7c8a1b6-bd0f-43c1-915d-0fdfb4249287 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:11.029152 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c7c8a1b6-bd0f-43c1-915d-0fdfb4249287 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:11.029961 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c7c8a1b6-bd0f-43c1-915d-0fdfb4249287 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:11.030852 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c7c8a1b6-bd0f-43c1-915d-0fdfb4249287 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:11.031547 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c7c8a1b6-bd0f-43c1-915d-0fdfb4249287 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:11.167940 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c7c8a1b6-bd0f-43c1-915d-0fdfb4249287 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:11.176061 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c7c8a1b6-bd0f-43c1-915d-0fdfb4249287 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1359 microversion: 2.1 time: 0.165589 Jun 06 21:14:11.176644 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 483/926] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:11 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:12.197939 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-8b5cfd57-e0cb-4ed8-8356-b1a49a16753c tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:12.198499 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-8b5cfd57-e0cb-4ed8-8356-b1a49a16753c tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:12.205376 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8b5cfd57-e0cb-4ed8-8356-b1a49a16753c tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:12.205813 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8b5cfd57-e0cb-4ed8-8356-b1a49a16753c tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:12.206569 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8b5cfd57-e0cb-4ed8-8356-b1a49a16753c tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:12.207016 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8b5cfd57-e0cb-4ed8-8356-b1a49a16753c tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:12.344013 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-8b5cfd57-e0cb-4ed8-8356-b1a49a16753c tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:12.351913 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-8b5cfd57-e0cb-4ed8-8356-b1a49a16753c tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1359 microversion: 2.1 time: 0.158082 Jun 06 21:14:12.352510 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 444/927] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:12 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:13.369534 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ee247237-50a8-4468-a524-817572ac3869 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:13.370105 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ee247237-50a8-4468-a524-817572ac3869 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:13.377744 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ee247237-50a8-4468-a524-817572ac3869 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:13.378342 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ee247237-50a8-4468-a524-817572ac3869 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:13.379506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ee247237-50a8-4468-a524-817572ac3869 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:13.380019 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ee247237-50a8-4468-a524-817572ac3869 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:13.532428 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ee247237-50a8-4468-a524-817572ac3869 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:13.544313 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ee247237-50a8-4468-a524-817572ac3869 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1359 microversion: 2.1 time: 0.178574 Jun 06 21:14:13.545090 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 484/928] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:13 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:13.790886 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-bc2b1db4-482a-445d-9192-abda1c9a1522 req-d092f053-1c34-4522-8160-abbb8c9da970 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7fe5e83-abc4-4dd8-b0db-8360ba722887", "name": "network-vif-plugged", "status": "completed", "tag": "38f344f4-4c2f-4d38-874b-72005dc25e05"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:14:13.802207 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-bc2b1db4-482a-445d-9192-abda1c9a1522 req-d092f053-1c34-4522-8160-abbb8c9da970 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:13.802871 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-bc2b1db4-482a-445d-9192-abda1c9a1522 req-d092f053-1c34-4522-8160-abbb8c9da970 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:13.817219 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-bc2b1db4-482a-445d-9192-abda1c9a1522 req-d092f053-1c34-4522-8160-abbb8c9da970 service nova] Creating event network-vif-plugged:38f344f4-4c2f-4d38-874b-72005dc25e05 for instance d7fe5e83-abc4-4dd8-b0db-8360ba722887 on hv-cinder-84488 Jun 06 21:14:13.823173 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-bc2b1db4-482a-445d-9192-abda1c9a1522 req-d092f053-1c34-4522-8160-abbb8c9da970 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036689 Jun 06 21:14:13.823845 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 445/929] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:14:14.562175 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c6ce3d64-a4f8-4f71-a001-7a3b1334f459 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:14.562807 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c6ce3d64-a4f8-4f71-a001-7a3b1334f459 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:14.571420 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c6ce3d64-a4f8-4f71-a001-7a3b1334f459 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:14.572076 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c6ce3d64-a4f8-4f71-a001-7a3b1334f459 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:14.573116 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c6ce3d64-a4f8-4f71-a001-7a3b1334f459 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:14.573731 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c6ce3d64-a4f8-4f71-a001-7a3b1334f459 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:14.718327 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c6ce3d64-a4f8-4f71-a001-7a3b1334f459 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:14.726231 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c6ce3d64-a4f8-4f71-a001-7a3b1334f459 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1359 microversion: 2.1 time: 0.167874 Jun 06 21:14:14.726804 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 485/930] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:14 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:15.743779 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-372d6caf-a02f-4f3e-af46-f466476732ce tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:15.745125 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-372d6caf-a02f-4f3e-af46-f466476732ce tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:15.753950 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-372d6caf-a02f-4f3e-af46-f466476732ce tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:15.754538 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-372d6caf-a02f-4f3e-af46-f466476732ce tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:15.755679 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-372d6caf-a02f-4f3e-af46-f466476732ce tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:15.756281 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-372d6caf-a02f-4f3e-af46-f466476732ce tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:15.904200 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-372d6caf-a02f-4f3e-af46-f466476732ce tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:15.912528 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-372d6caf-a02f-4f3e-af46-f466476732ce tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1549 microversion: 2.1 time: 0.173269 Jun 06 21:14:15.913116 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 446/931] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:15 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:15.929229 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b0a19ee1-72a3-46fd-93ef-6bdf7772a79e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:15.930009 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b0a19ee1-72a3-46fd-93ef-6bdf7772a79e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:15.937097 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b0a19ee1-72a3-46fd-93ef-6bdf7772a79e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:15.937589 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b0a19ee1-72a3-46fd-93ef-6bdf7772a79e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:15.938645 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b0a19ee1-72a3-46fd-93ef-6bdf7772a79e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:15.938821 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b0a19ee1-72a3-46fd-93ef-6bdf7772a79e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:16.078866 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b0a19ee1-72a3-46fd-93ef-6bdf7772a79e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:16.086817 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b0a19ee1-72a3-46fd-93ef-6bdf7772a79e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1549 microversion: 2.1 time: 0.161391 Jun 06 21:14:16.087413 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 486/932] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:15 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:16.107527 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-5d7b9e08-bf20-48c7-99d6-d6b79455a4d1 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:16.110977 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-5d7b9e08-bf20-48c7-99d6-d6b79455a4d1 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:16.111736 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-5d7b9e08-bf20-48c7-99d6-d6b79455a4d1 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Searching by: {'deleted': False, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521'} {{(pid=117860) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 06 21:14:16.119462 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5d7b9e08-bf20-48c7-99d6-d6b79455a4d1 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:16.119934 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5d7b9e08-bf20-48c7-99d6-d6b79455a4d1 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:16.120755 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5d7b9e08-bf20-48c7-99d6-d6b79455a4d1 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:16.121185 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5d7b9e08-bf20-48c7-99d6-d6b79455a4d1 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:16.214772 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.multi_cell_list [None req-5d7b9e08-bf20-48c7-99d6-d6b79455a4d1 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117860) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 06 21:14:16.312274 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-5d7b9e08-bf20-48c7-99d6-d6b79455a4d1 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.212423 Jun 06 21:14:16.312896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 447/933] 10.222.0.33 () {58 vars in 1124 bytes} [Mon Jun 6 21:14:16 2022] GET /compute/v2.1/servers => generated 343 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:14:16.324027 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-351a632f-2b00-4d77-bf5e-ec72c07597b4 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:16.324659 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-351a632f-2b00-4d77-bf5e-ec72c07597b4 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:16.331500 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-351a632f-2b00-4d77-bf5e-ec72c07597b4 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:16.331957 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-351a632f-2b00-4d77-bf5e-ec72c07597b4 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:16.332747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-351a632f-2b00-4d77-bf5e-ec72c07597b4 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:16.333180 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-351a632f-2b00-4d77-bf5e-ec72c07597b4 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:16.475069 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-351a632f-2b00-4d77-bf5e-ec72c07597b4 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:16.485563 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-351a632f-2b00-4d77-bf5e-ec72c07597b4 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1549 microversion: 2.1 time: 0.165615 Jun 06 21:14:16.492725 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 487/934] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:16 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1549 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:17.730138 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2d1c902e-f80f-4f57-bda5-4b0ffbee34da tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:17.730775 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-2d1c902e-f80f-4f57-bda5-4b0ffbee34da tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:17.738608 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2d1c902e-f80f-4f57-bda5-4b0ffbee34da tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:17.739101 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2d1c902e-f80f-4f57-bda5-4b0ffbee34da tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:17.739861 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2d1c902e-f80f-4f57-bda5-4b0ffbee34da tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:17.740312 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2d1c902e-f80f-4f57-bda5-4b0ffbee34da tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:17.845061 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.objects.instance [None req-2d1c902e-f80f-4f57-bda5-4b0ffbee34da tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lazy-loading 'services' on Instance uuid ce90b0bc-be67-4862-bac1-77835f2d7a0f {{(pid=117860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:14:17.943543 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-2d1c902e-f80f-4f57-bda5-4b0ffbee34da tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f/os-volume_attachments/de036f78-a299-4903-ae53-5b451a23e2b7" status: 202 len: 0 microversion: 2.1 time: 0.217844 Jun 06 21:14:17.944184 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 448/935] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 6 21:14:17 2022] DELETE /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f/os-volume_attachments/de036f78-a299-4903-ae53-5b451a23e2b7 => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:14:18.108443 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1a500b68-876e-433e-a865-1c22d1efd809 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdc4baaf-2ab3-4685-beac-a5215e00e613"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:14:18.109893 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1a500b68-876e-433e-a865-1c22d1efd809 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:18.117066 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a500b68-876e-433e-a865-1c22d1efd809 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:18.117642 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a500b68-876e-433e-a865-1c22d1efd809 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:18.118687 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a500b68-876e-433e-a865-1c22d1efd809 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:18.119118 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1a500b68-876e-433e-a865-1c22d1efd809 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:18.581155 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1a500b68-876e-433e-a865-1c22d1efd809 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "POST /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.476434 Jun 06 21:14:18.581766 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 488/936] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 6 21:14:18 2022] POST /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887/os-volume_attachments => generated 194 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:14:19.095731 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-c1967eeb-a6f2-45a8-9145-e0710aff9dcb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:14:19.103497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c1967eeb-a6f2-45a8-9145-e0710aff9dcb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:19.103807 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c1967eeb-a6f2-45a8-9145-e0710aff9dcb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:19.129247 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-c1967eeb-a6f2-45a8-9145-e0710aff9dcb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Going to try to stop instance {{(pid=117860) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 06 21:14:19.186533 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-c1967eeb-a6f2-45a8-9145-e0710aff9dcb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "POST /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f/action" status: 202 len: 0 microversion: 2.1 time: 0.095448 Jun 06 21:14:19.187167 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 449/937] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 6 21:14:19 2022] POST /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f/action => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:14:19.199282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fe3618e5-3d91-4789-aa12-496ab500e7af tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:19.200233 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fe3618e5-3d91-4789-aa12-496ab500e7af tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:19.211314 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe3618e5-3d91-4789-aa12-496ab500e7af tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:19.212423 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe3618e5-3d91-4789-aa12-496ab500e7af tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:19.212780 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe3618e5-3d91-4789-aa12-496ab500e7af tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:19.213302 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fe3618e5-3d91-4789-aa12-496ab500e7af tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:19.368365 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fe3618e5-3d91-4789-aa12-496ab500e7af tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:19.376757 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fe3618e5-3d91-4789-aa12-496ab500e7af tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1677 microversion: 2.1 time: 0.184255 Jun 06 21:14:19.377342 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 489/938] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:19 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1677 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:20.398876 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b2c307c9-6db5-4360-b03f-5b03a4e7fded tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:20.399578 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-b2c307c9-6db5-4360-b03f-5b03a4e7fded tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:20.406731 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b2c307c9-6db5-4360-b03f-5b03a4e7fded tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:20.407187 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b2c307c9-6db5-4360-b03f-5b03a4e7fded tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:20.407966 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b2c307c9-6db5-4360-b03f-5b03a4e7fded tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:20.408437 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b2c307c9-6db5-4360-b03f-5b03a4e7fded tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:20.556061 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-b2c307c9-6db5-4360-b03f-5b03a4e7fded tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:20.565937 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-b2c307c9-6db5-4360-b03f-5b03a4e7fded tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1677 microversion: 2.1 time: 0.171764 Jun 06 21:14:20.566637 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 450/939] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:20 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:21.586142 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-c1722db0-bdf6-4c31-97f2-8a012670e4e0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:21.586750 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-c1722db0-bdf6-4c31-97f2-8a012670e4e0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:21.593754 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c1722db0-bdf6-4c31-97f2-8a012670e4e0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:21.594227 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c1722db0-bdf6-4c31-97f2-8a012670e4e0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:21.594979 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c1722db0-bdf6-4c31-97f2-8a012670e4e0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:21.595403 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-c1722db0-bdf6-4c31-97f2-8a012670e4e0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:21.735888 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-c1722db0-bdf6-4c31-97f2-8a012670e4e0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:21.743539 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-c1722db0-bdf6-4c31-97f2-8a012670e4e0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1677 microversion: 2.1 time: 0.161395 Jun 06 21:14:21.744620 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 490/940] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:21 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:22.762003 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e07fbed4-d389-496a-a472-b68b13c66b36 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:22.762586 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-e07fbed4-d389-496a-a472-b68b13c66b36 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:22.769649 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e07fbed4-d389-496a-a472-b68b13c66b36 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:22.770246 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e07fbed4-d389-496a-a472-b68b13c66b36 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:22.771362 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e07fbed4-d389-496a-a472-b68b13c66b36 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:22.771785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e07fbed4-d389-496a-a472-b68b13c66b36 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:22.918224 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e07fbed4-d389-496a-a472-b68b13c66b36 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:22.925961 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-e07fbed4-d389-496a-a472-b68b13c66b36 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1677 microversion: 2.1 time: 0.168344 Jun 06 21:14:22.926527 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 451/941] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:22 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:23.947984 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0cf07add-5466-4be9-8556-2f824348c7f9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:23.948828 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0cf07add-5466-4be9-8556-2f824348c7f9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:23.956286 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0cf07add-5466-4be9-8556-2f824348c7f9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:23.956723 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0cf07add-5466-4be9-8556-2f824348c7f9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:23.957495 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0cf07add-5466-4be9-8556-2f824348c7f9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:23.957973 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0cf07add-5466-4be9-8556-2f824348c7f9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:24.124897 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0cf07add-5466-4be9-8556-2f824348c7f9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:24.132841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0cf07add-5466-4be9-8556-2f824348c7f9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1677 microversion: 2.1 time: 0.189086 Jun 06 21:14:24.133418 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 491/942] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:23 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1677 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:25.152213 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-df34aa3b-2475-420e-ba22-71dacab2a5c5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:25.153020 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-df34aa3b-2475-420e-ba22-71dacab2a5c5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:25.158870 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-df34aa3b-2475-420e-ba22-71dacab2a5c5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:25.159327 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-df34aa3b-2475-420e-ba22-71dacab2a5c5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:25.160137 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-df34aa3b-2475-420e-ba22-71dacab2a5c5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:25.160606 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-df34aa3b-2475-420e-ba22-71dacab2a5c5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:25.299135 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-df34aa3b-2475-420e-ba22-71dacab2a5c5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:25.309420 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-df34aa3b-2475-420e-ba22-71dacab2a5c5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1677 microversion: 2.1 time: 0.162043 Jun 06 21:14:25.310246 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 452/943] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:25 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:26.173968 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-01308099-7ad9-4e4c-8580-7a1f4ec2d275 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:26.174623 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-01308099-7ad9-4e4c-8580-7a1f4ec2d275 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:26.181914 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-01308099-7ad9-4e4c-8580-7a1f4ec2d275 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:26.182342 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-01308099-7ad9-4e4c-8580-7a1f4ec2d275 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:26.183709 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-01308099-7ad9-4e4c-8580-7a1f4ec2d275 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:26.184166 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-01308099-7ad9-4e4c-8580-7a1f4ec2d275 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:26.327904 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-d56b66d0-24c4-4fda-a502-53e439a347f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:26.328498 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-01308099-7ad9-4e4c-8580-7a1f4ec2d275 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:26.328639 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-d56b66d0-24c4-4fda-a502-53e439a347f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:26.331141 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=2 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:14:26.337344 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-01308099-7ad9-4e4c-8580-7a1f4ec2d275 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1595 microversion: 2.1 time: 0.167297 Jun 06 21:14:26.337586 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d56b66d0-24c4-4fda-a502-53e439a347f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:26.337947 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d56b66d0-24c4-4fda-a502-53e439a347f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:26.338157 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 492/944] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:26 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1595 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:26.341697 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d56b66d0-24c4-4fda-a502-53e439a347f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:26.342153 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d56b66d0-24c4-4fda-a502-53e439a347f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:26.519374 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-d56b66d0-24c4-4fda-a502-53e439a347f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:26.527551 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-d56b66d0-24c4-4fda-a502-53e439a347f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1677 microversion: 2.1 time: 0.204154 Jun 06 21:14:26.528269 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 453/945] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:26 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1677 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:27.545579 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d8191c6b-39f7-4c5b-b07e-8f9904fc5025 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:27.546176 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d8191c6b-39f7-4c5b-b07e-8f9904fc5025 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:27.553123 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8191c6b-39f7-4c5b-b07e-8f9904fc5025 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:27.553558 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8191c6b-39f7-4c5b-b07e-8f9904fc5025 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:27.554336 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8191c6b-39f7-4c5b-b07e-8f9904fc5025 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:27.554783 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d8191c6b-39f7-4c5b-b07e-8f9904fc5025 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:27.575379 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:14:28.067012 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d8191c6b-39f7-4c5b-b07e-8f9904fc5025 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:28.075714 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d8191c6b-39f7-4c5b-b07e-8f9904fc5025 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1677 microversion: 2.1 time: 0.534477 Jun 06 21:14:28.076348 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 493/946] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:27 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1677 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:28.466286 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-a605286d-d5f2-4c10-94f0-b422047cfb56 req-e04dbe75-78ec-416d-ab17-7c9718dbd717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7fe5e83-abc4-4dd8-b0db-8360ba722887", "tag": "38f344f4-4c2f-4d38-874b-72005dc25e05"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:14:28.476188 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-a605286d-d5f2-4c10-94f0-b422047cfb56 req-e04dbe75-78ec-416d-ab17-7c9718dbd717 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:28.476749 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-a605286d-d5f2-4c10-94f0-b422047cfb56 req-e04dbe75-78ec-416d-ab17-7c9718dbd717 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:28.481495 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:14:28.490765 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-a605286d-d5f2-4c10-94f0-b422047cfb56 req-e04dbe75-78ec-416d-ab17-7c9718dbd717 service nova] Creating event network-changed:38f344f4-4c2f-4d38-874b-72005dc25e05 for instance d7fe5e83-abc4-4dd8-b0db-8360ba722887 on hv-cinder-84488 Jun 06 21:14:28.496506 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-a605286d-d5f2-4c10-94f0-b422047cfb56 req-e04dbe75-78ec-416d-ab17-7c9718dbd717 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034265 Jun 06 21:14:28.497516 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 454/947] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:14:29.102739 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-580fd0d9-0290-4da6-a739-50a4e8f37c07 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:29.104364 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-580fd0d9-0290-4da6-a739-50a4e8f37c07 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:29.108365 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:14:29.123636 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-580fd0d9-0290-4da6-a739-50a4e8f37c07 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:29.124414 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-580fd0d9-0290-4da6-a739-50a4e8f37c07 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:29.125520 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-580fd0d9-0290-4da6-a739-50a4e8f37c07 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:29.126122 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-580fd0d9-0290-4da6-a739-50a4e8f37c07 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:29.341572 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-580fd0d9-0290-4da6-a739-50a4e8f37c07 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:29.349317 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-580fd0d9-0290-4da6-a739-50a4e8f37c07 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1677 microversion: 2.1 time: 0.255685 Jun 06 21:14:29.349926 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 494/948] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:29 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1677 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:29.812599 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-5d5fe54b-b6bc-47ba-aefd-6ecc6faea508 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-760339005"}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:14:29.813227 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-5d5fe54b-b6bc-47ba-aefd-6ecc6faea508 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:29.815233 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:14:29.822152 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5d5fe54b-b6bc-47ba-aefd-6ecc6faea508 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:29.822591 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5d5fe54b-b6bc-47ba-aefd-6ecc6faea508 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:29.823490 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5d5fe54b-b6bc-47ba-aefd-6ecc6faea508 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:29.824679 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-5d5fe54b-b6bc-47ba-aefd-6ecc6faea508 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:30.083589 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.network.security_group_api [None req-5d5fe54b-b6bc-47ba-aefd-6ecc6faea508 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Adding security group a8c0c7de-10cb-49a0-9d64-0e554af47eda to port 38f344f4-4c2f-4d38-874b-72005dc25e05 Jun 06 21:14:30.366544 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ea42c44d-c1d9-4067-84c1-dfd76b668232 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:30.367127 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ea42c44d-c1d9-4067-84c1-dfd76b668232 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:30.374217 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ea42c44d-c1d9-4067-84c1-dfd76b668232 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:30.374663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ea42c44d-c1d9-4067-84c1-dfd76b668232 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:30.375419 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ea42c44d-c1d9-4067-84c1-dfd76b668232 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:30.375891 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ea42c44d-c1d9-4067-84c1-dfd76b668232 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:30.515119 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-ea42c44d-c1d9-4067-84c1-dfd76b668232 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:30.530490 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ea42c44d-c1d9-4067-84c1-dfd76b668232 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1654 microversion: 2.1 time: 0.167737 Jun 06 21:14:30.531661 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 495/949] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:30 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1654 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:30.535766 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-5d5fe54b-b6bc-47ba-aefd-6ecc6faea508 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "POST /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887/action" status: 202 len: 0 microversion: 2.1 time: 0.729015 Jun 06 21:14:30.536457 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 455/950] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 6 21:14:29 2022] POST /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887/action => generated 0 bytes in 731 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:14:30.555013 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6896a8f9-34ab-4f17-b210-b6285721f242 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:30.556194 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-6896a8f9-34ab-4f17-b210-b6285721f242 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:30.562360 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-895a82d3-3a77-4fb5-83b1-f01deaec2f2b req-f01cc82b-7a2b-480d-b495-764d3b1f57e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7fe5e83-abc4-4dd8-b0db-8360ba722887", "tag": "38f344f4-4c2f-4d38-874b-72005dc25e05"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:14:30.575074 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6896a8f9-34ab-4f17-b210-b6285721f242 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:30.575701 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6896a8f9-34ab-4f17-b210-b6285721f242 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:30.576611 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6896a8f9-34ab-4f17-b210-b6285721f242 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:30.579137 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-6896a8f9-34ab-4f17-b210-b6285721f242 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:30.583829 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-895a82d3-3a77-4fb5-83b1-f01deaec2f2b req-f01cc82b-7a2b-480d-b495-764d3b1f57e6 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:30.584897 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-895a82d3-3a77-4fb5-83b1-f01deaec2f2b req-f01cc82b-7a2b-480d-b495-764d3b1f57e6 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:30.615537 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-895a82d3-3a77-4fb5-83b1-f01deaec2f2b req-f01cc82b-7a2b-480d-b495-764d3b1f57e6 service nova] Creating event network-changed:38f344f4-4c2f-4d38-874b-72005dc25e05 for instance d7fe5e83-abc4-4dd8-b0db-8360ba722887 on hv-cinder-84488 Jun 06 21:14:30.628160 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-895a82d3-3a77-4fb5-83b1-f01deaec2f2b req-f01cc82b-7a2b-480d-b495-764d3b1f57e6 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071152 Jun 06 21:14:30.629785 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 456/951] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:14:30.639742 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-d982d265-9f8e-4f6d-9216-f1ee263d5684 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:14:30.653294 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d982d265-9f8e-4f6d-9216-f1ee263d5684 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:30.654128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-d982d265-9f8e-4f6d-9216-f1ee263d5684 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:30.692185 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-d982d265-9f8e-4f6d-9216-f1ee263d5684 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Going to try to start instance {{(pid=117860) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 06 21:14:30.759092 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-d982d265-9f8e-4f6d-9216-f1ee263d5684 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "POST /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f/action" status: 202 len: 0 microversion: 2.1 time: 0.127315 Jun 06 21:14:30.764446 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 457/952] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 6 21:14:30 2022] POST /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:14:30.770284 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-21a066bd-1a0b-4bce-8674-2d08499cf0ab tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:30.771273 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-21a066bd-1a0b-4bce-8674-2d08499cf0ab tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:30.781610 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-21a066bd-1a0b-4bce-8674-2d08499cf0ab tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:30.782336 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-21a066bd-1a0b-4bce-8674-2d08499cf0ab tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:30.784400 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-21a066bd-1a0b-4bce-8674-2d08499cf0ab tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:30.785188 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-21a066bd-1a0b-4bce-8674-2d08499cf0ab tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:30.865257 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-6896a8f9-34ab-4f17-b210-b6285721f242 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:30.875616 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6896a8f9-34ab-4f17-b210-b6285721f242 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1760 microversion: 2.1 time: 0.330026 Jun 06 21:14:30.889032 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 496/953] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:30 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1760 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:14:31.123705 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-21a066bd-1a0b-4bce-8674-2d08499cf0ab tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:31.132113 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-21a066bd-1a0b-4bce-8674-2d08499cf0ab tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1663 microversion: 2.1 time: 0.365920 Jun 06 21:14:31.132973 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 458/954] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:30 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1663 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:32.149785 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d9b6f018-f60e-48a0-ae1c-d7e82c65db74 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:32.150362 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d9b6f018-f60e-48a0-ae1c-d7e82c65db74 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:32.158098 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d9b6f018-f60e-48a0-ae1c-d7e82c65db74 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:32.158577 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d9b6f018-f60e-48a0-ae1c-d7e82c65db74 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:32.159425 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d9b6f018-f60e-48a0-ae1c-d7e82c65db74 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:32.159862 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d9b6f018-f60e-48a0-ae1c-d7e82c65db74 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:32.383960 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d9b6f018-f60e-48a0-ae1c-d7e82c65db74 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:32.392398 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d9b6f018-f60e-48a0-ae1c-d7e82c65db74 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1663 microversion: 2.1 time: 0.246632 Jun 06 21:14:32.392944 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 497/955] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:32 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1663 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:33.411941 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-cb19b2bb-c6d1-4026-bca8-ab4e40e7eef8 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:33.412725 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-cb19b2bb-c6d1-4026-bca8-ab4e40e7eef8 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:33.420903 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-cb19b2bb-c6d1-4026-bca8-ab4e40e7eef8 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:33.421355 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-cb19b2bb-c6d1-4026-bca8-ab4e40e7eef8 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:33.422147 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-cb19b2bb-c6d1-4026-bca8-ab4e40e7eef8 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:33.422575 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-cb19b2bb-c6d1-4026-bca8-ab4e40e7eef8 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:33.573368 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-cb19b2bb-c6d1-4026-bca8-ab4e40e7eef8 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:33.581719 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-cb19b2bb-c6d1-4026-bca8-ab4e40e7eef8 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1667 microversion: 2.1 time: 0.175009 Jun 06 21:14:33.582309 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 459/956] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:33 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1667 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:53.370602 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f5a586af-63fe-490e-b39a-36dd452ae574 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:14:53.371542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f5a586af-63fe-490e-b39a-36dd452ae574 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:53.374121 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=7 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:14:53.374761 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=26 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:14:53.380566 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f5a586af-63fe-490e-b39a-36dd452ae574 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:53.381004 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f5a586af-63fe-490e-b39a-36dd452ae574 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:53.381761 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f5a586af-63fe-490e-b39a-36dd452ae574 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:53.382210 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f5a586af-63fe-490e-b39a-36dd452ae574 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:53.461670 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f5a586af-63fe-490e-b39a-36dd452ae574 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "POST /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887/action" status: 202 len: 0 microversion: 2.1 time: 0.094939 Jun 06 21:14:53.462299 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 498/957] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 6 21:14:53 2022] POST /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:14:53.470611 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=9 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:14:53.471487 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:14:53.475385 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-c9ea8f27-a3f4-4a35-9498-93ac773b4f2e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:53.476003 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-c9ea8f27-a3f4-4a35-9498-93ac773b4f2e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:53.483934 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c9ea8f27-a3f4-4a35-9498-93ac773b4f2e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:53.484481 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c9ea8f27-a3f4-4a35-9498-93ac773b4f2e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:53.485344 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c9ea8f27-a3f4-4a35-9498-93ac773b4f2e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:53.485770 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-c9ea8f27-a3f4-4a35-9498-93ac773b4f2e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:53.741734 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-c9ea8f27-a3f4-4a35-9498-93ac773b4f2e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:53.749948 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-c9ea8f27-a3f4-4a35-9498-93ac773b4f2e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1752 microversion: 2.1 time: 0.281039 Jun 06 21:14:53.751324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 460/958] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:53 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1752 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:54.770721 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-b8045228-1644-454b-9701-d0624c37895b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:54.771301 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-b8045228-1644-454b-9701-d0624c37895b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:54.778581 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b8045228-1644-454b-9701-d0624c37895b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:54.779023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b8045228-1644-454b-9701-d0624c37895b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:54.779793 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b8045228-1644-454b-9701-d0624c37895b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:54.780253 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-b8045228-1644-454b-9701-d0624c37895b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:54.933393 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-b8045228-1644-454b-9701-d0624c37895b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:54.947050 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-b8045228-1644-454b-9701-d0624c37895b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1757 microversion: 2.1 time: 0.181583 Jun 06 21:14:54.947880 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 499/959] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:54 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:55.967247 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-be200c7e-bbac-4d53-837f-4825f23eb8e2 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:55.967880 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-be200c7e-bbac-4d53-837f-4825f23eb8e2 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:55.974915 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-be200c7e-bbac-4d53-837f-4825f23eb8e2 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:55.975352 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-be200c7e-bbac-4d53-837f-4825f23eb8e2 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:55.976150 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-be200c7e-bbac-4d53-837f-4825f23eb8e2 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:55.976573 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-be200c7e-bbac-4d53-837f-4825f23eb8e2 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:56.141297 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-be200c7e-bbac-4d53-837f-4825f23eb8e2 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:56.154372 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-be200c7e-bbac-4d53-837f-4825f23eb8e2 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1757 microversion: 2.1 time: 0.190610 Jun 06 21:14:56.155231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 461/960] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:55 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:57.173911 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4cdd781e-bf5f-496b-a7f8-4bc6cd48923f tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:57.174501 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4cdd781e-bf5f-496b-a7f8-4bc6cd48923f tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:57.181650 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4cdd781e-bf5f-496b-a7f8-4bc6cd48923f tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:57.182108 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4cdd781e-bf5f-496b-a7f8-4bc6cd48923f tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:57.182865 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4cdd781e-bf5f-496b-a7f8-4bc6cd48923f tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:57.183300 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4cdd781e-bf5f-496b-a7f8-4bc6cd48923f tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:57.341865 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4cdd781e-bf5f-496b-a7f8-4bc6cd48923f tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:57.354107 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4cdd781e-bf5f-496b-a7f8-4bc6cd48923f tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1757 microversion: 2.1 time: 0.184475 Jun 06 21:14:57.354873 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 500/961] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:57 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:58.372337 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-4e47f245-532f-4c52-83b8-09f32c65f33c tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:58.372879 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-4e47f245-532f-4c52-83b8-09f32c65f33c tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:58.379581 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4e47f245-532f-4c52-83b8-09f32c65f33c tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:58.380032 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4e47f245-532f-4c52-83b8-09f32c65f33c tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:58.380791 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4e47f245-532f-4c52-83b8-09f32c65f33c tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:58.381216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4e47f245-532f-4c52-83b8-09f32c65f33c tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:58.536212 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-4e47f245-532f-4c52-83b8-09f32c65f33c tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:58.544365 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-4e47f245-532f-4c52-83b8-09f32c65f33c tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1757 microversion: 2.1 time: 0.176130 Jun 06 21:14:58.544911 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 462/962] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:58 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:14:59.563075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a1d59c15-7889-4c68-ba01-b240287e6915 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:14:59.563850 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a1d59c15-7889-4c68-ba01-b240287e6915 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:14:59.570976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a1d59c15-7889-4c68-ba01-b240287e6915 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:59.571432 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a1d59c15-7889-4c68-ba01-b240287e6915 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:59.572245 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a1d59c15-7889-4c68-ba01-b240287e6915 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:14:59.572660 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a1d59c15-7889-4c68-ba01-b240287e6915 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:14:59.721061 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a1d59c15-7889-4c68-ba01-b240287e6915 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:14:59.731902 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a1d59c15-7889-4c68-ba01-b240287e6915 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1757 microversion: 2.1 time: 0.172947 Jun 06 21:14:59.732867 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 501/963] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:14:59 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:00.752629 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-4f99d3e9-3d37-4ae3-98e9-7877e802dee7 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:00.753277 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-4f99d3e9-3d37-4ae3-98e9-7877e802dee7 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:00.760098 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4f99d3e9-3d37-4ae3-98e9-7877e802dee7 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:00.760542 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4f99d3e9-3d37-4ae3-98e9-7877e802dee7 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:00.761292 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4f99d3e9-3d37-4ae3-98e9-7877e802dee7 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:00.761712 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4f99d3e9-3d37-4ae3-98e9-7877e802dee7 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:00.913773 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-4f99d3e9-3d37-4ae3-98e9-7877e802dee7 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:00.925803 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-4f99d3e9-3d37-4ae3-98e9-7877e802dee7 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1757 microversion: 2.1 time: 0.178504 Jun 06 21:15:00.926372 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 463/964] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:00 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:01.948526 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-772b874e-78d4-4072-9dd3-a004931d6c67 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:01.949134 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-772b874e-78d4-4072-9dd3-a004931d6c67 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:01.957235 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-772b874e-78d4-4072-9dd3-a004931d6c67 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:01.957740 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-772b874e-78d4-4072-9dd3-a004931d6c67 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:01.958498 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-772b874e-78d4-4072-9dd3-a004931d6c67 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:01.958931 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-772b874e-78d4-4072-9dd3-a004931d6c67 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:02.115389 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-772b874e-78d4-4072-9dd3-a004931d6c67 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:02.127771 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-772b874e-78d4-4072-9dd3-a004931d6c67 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1757 microversion: 2.1 time: 0.182994 Jun 06 21:15:02.128365 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 502/965] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:01 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:03.146570 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-bd727b9d-d9b1-45a8-900c-e3c5d8b437a1 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:03.147147 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-bd727b9d-d9b1-45a8-900c-e3c5d8b437a1 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:03.154026 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bd727b9d-d9b1-45a8-900c-e3c5d8b437a1 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:03.154435 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bd727b9d-d9b1-45a8-900c-e3c5d8b437a1 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:03.155185 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bd727b9d-d9b1-45a8-900c-e3c5d8b437a1 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:03.155605 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bd727b9d-d9b1-45a8-900c-e3c5d8b437a1 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:03.312091 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-bd727b9d-d9b1-45a8-900c-e3c5d8b437a1 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:03.325414 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-bd727b9d-d9b1-45a8-900c-e3c5d8b437a1 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1757 microversion: 2.1 time: 0.183412 Jun 06 21:15:03.326237 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 464/966] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:03 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1757 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:04.347754 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-450b73a2-7870-427f-b4a5-301701da7a86 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:04.348399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-450b73a2-7870-427f-b4a5-301701da7a86 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:04.355953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-450b73a2-7870-427f-b4a5-301701da7a86 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:04.356439 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-450b73a2-7870-427f-b4a5-301701da7a86 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:04.357206 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-450b73a2-7870-427f-b4a5-301701da7a86 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:04.357631 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-450b73a2-7870-427f-b4a5-301701da7a86 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:04.511827 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-450b73a2-7870-427f-b4a5-301701da7a86 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:04.523608 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-450b73a2-7870-427f-b4a5-301701da7a86 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1757 microversion: 2.1 time: 0.181659 Jun 06 21:15:04.524271 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 503/967] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:04 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:05.542142 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-355ac1cb-b10e-4829-8326-7296aeca42dd tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:05.542769 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-355ac1cb-b10e-4829-8326-7296aeca42dd tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:05.550328 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-355ac1cb-b10e-4829-8326-7296aeca42dd tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:05.550751 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-355ac1cb-b10e-4829-8326-7296aeca42dd tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:05.551541 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-355ac1cb-b10e-4829-8326-7296aeca42dd tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:05.552010 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-355ac1cb-b10e-4829-8326-7296aeca42dd tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:05.709034 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-355ac1cb-b10e-4829-8326-7296aeca42dd tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:05.717155 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-355ac1cb-b10e-4829-8326-7296aeca42dd tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1757 microversion: 2.1 time: 0.179011 Jun 06 21:15:05.717720 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 465/968] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:05 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:06.736545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-96a14f3e-ef34-4fe3-aada-26043bf92841 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:06.737146 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-96a14f3e-ef34-4fe3-aada-26043bf92841 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:06.744690 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-96a14f3e-ef34-4fe3-aada-26043bf92841 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:06.745123 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-96a14f3e-ef34-4fe3-aada-26043bf92841 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:06.745894 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-96a14f3e-ef34-4fe3-aada-26043bf92841 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:06.746318 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-96a14f3e-ef34-4fe3-aada-26043bf92841 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:06.922232 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-96a14f3e-ef34-4fe3-aada-26043bf92841 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:06.932614 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-96a14f3e-ef34-4fe3-aada-26043bf92841 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1757 microversion: 2.1 time: 0.201828 Jun 06 21:15:06.933184 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 504/969] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:06 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1757 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:07.953272 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-128d4740-4dfd-4d88-b78f-d92b6206d39f tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:07.953848 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-128d4740-4dfd-4d88-b78f-d92b6206d39f tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:07.963787 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-128d4740-4dfd-4d88-b78f-d92b6206d39f tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:07.964403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-128d4740-4dfd-4d88-b78f-d92b6206d39f tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:07.965425 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-128d4740-4dfd-4d88-b78f-d92b6206d39f tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:07.965988 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-128d4740-4dfd-4d88-b78f-d92b6206d39f tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:08.119534 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-128d4740-4dfd-4d88-b78f-d92b6206d39f tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:08.131325 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-128d4740-4dfd-4d88-b78f-d92b6206d39f tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1757 microversion: 2.1 time: 0.184883 Jun 06 21:15:08.131901 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 466/970] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:07 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:09.040009 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-9956c24a-7ff4-4b57-b304-83082c39ccd7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:09.041000 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-9956c24a-7ff4-4b57-b304-83082c39ccd7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:09.048451 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9956c24a-7ff4-4b57-b304-83082c39ccd7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:09.048900 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9956c24a-7ff4-4b57-b304-83082c39ccd7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:09.049663 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9956c24a-7ff4-4b57-b304-83082c39ccd7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:09.050090 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-9956c24a-7ff4-4b57-b304-83082c39ccd7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:09.080391 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-9956c24a-7ff4-4b57-b304-83082c39ccd7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044331 Jun 06 21:15:09.080946 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 505/971] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 6 21:15:09 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 21:15:09.151616 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-565a1879-0ebc-444f-b1a9-20f0a3e68183 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:09.152447 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-565a1879-0ebc-444f-b1a9-20f0a3e68183 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:09.153931 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-401859a8-589f-4d99-b8b0-5e87566764c2 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:09.154528 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-401859a8-589f-4d99-b8b0-5e87566764c2 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:09.159650 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-565a1879-0ebc-444f-b1a9-20f0a3e68183 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:09.160164 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-565a1879-0ebc-444f-b1a9-20f0a3e68183 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:09.160492 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-401859a8-589f-4d99-b8b0-5e87566764c2 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:09.160934 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-565a1879-0ebc-444f-b1a9-20f0a3e68183 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:09.161036 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-401859a8-589f-4d99-b8b0-5e87566764c2 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:09.161366 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-565a1879-0ebc-444f-b1a9-20f0a3e68183 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:09.161754 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-401859a8-589f-4d99-b8b0-5e87566764c2 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:09.162273 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-401859a8-589f-4d99-b8b0-5e87566764c2 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:09.189784 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-565a1879-0ebc-444f-b1a9-20f0a3e68183 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Going to try to terminate instance {{(pid=117860) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 21:15:09.275777 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-565a1879-0ebc-444f-b1a9-20f0a3e68183 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 204 len: 0 microversion: 2.1 time: 0.128640 Jun 06 21:15:09.276431 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 467/972] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:15:09 2022] DELETE /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 21:15:09.285667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-75338b73-7047-4eae-99d4-94470154b468 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:09.286083 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-75338b73-7047-4eae-99d4-94470154b468 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:09.293781 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-75338b73-7047-4eae-99d4-94470154b468 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:09.294223 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-75338b73-7047-4eae-99d4-94470154b468 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:09.295046 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-75338b73-7047-4eae-99d4-94470154b468 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:09.295474 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-75338b73-7047-4eae-99d4-94470154b468 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:09.318754 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-401859a8-589f-4d99-b8b0-5e87566764c2 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:09.326816 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-401859a8-589f-4d99-b8b0-5e87566764c2 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1757 microversion: 2.1 time: 0.176700 Jun 06 21:15:09.327730 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 506/973] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:09 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:09.434585 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-75338b73-7047-4eae-99d4-94470154b468 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:09.444671 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-75338b73-7047-4eae-99d4-94470154b468 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1673 microversion: 2.1 time: 0.163500 Jun 06 21:15:09.445262 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 468/974] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:09 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:15:10.346102 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-46397bbf-3cd0-408b-98b3-772005eb4012 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:10.346701 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-46397bbf-3cd0-408b-98b3-772005eb4012 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:10.353446 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-46397bbf-3cd0-408b-98b3-772005eb4012 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:10.353890 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-46397bbf-3cd0-408b-98b3-772005eb4012 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:10.354642 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-46397bbf-3cd0-408b-98b3-772005eb4012 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:10.355062 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-46397bbf-3cd0-408b-98b3-772005eb4012 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:10.462598 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-727f904f-52b3-402b-bdc0-d4b7d0e14849 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:10.463215 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-727f904f-52b3-402b-bdc0-d4b7d0e14849 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:10.470064 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-727f904f-52b3-402b-bdc0-d4b7d0e14849 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:10.470540 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-727f904f-52b3-402b-bdc0-d4b7d0e14849 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:10.471288 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-727f904f-52b3-402b-bdc0-d4b7d0e14849 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:10.471715 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-727f904f-52b3-402b-bdc0-d4b7d0e14849 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:10.503088 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-46397bbf-3cd0-408b-98b3-772005eb4012 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:10.511823 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-46397bbf-3cd0-408b-98b3-772005eb4012 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1757 microversion: 2.1 time: 0.169712 Jun 06 21:15:10.512448 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 507/975] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:10 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:10.603561 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-727f904f-52b3-402b-bdc0-d4b7d0e14849 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:10.615227 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-727f904f-52b3-402b-bdc0-d4b7d0e14849 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1673 microversion: 2.1 time: 0.156301 Jun 06 21:15:10.616221 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 469/976] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:10 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:11.529635 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5dedbef2-19d2-4a1e-8890-5020fd2c2f20 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:11.530290 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5dedbef2-19d2-4a1e-8890-5020fd2c2f20 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:11.537897 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5dedbef2-19d2-4a1e-8890-5020fd2c2f20 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:11.538286 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5dedbef2-19d2-4a1e-8890-5020fd2c2f20 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:11.539065 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5dedbef2-19d2-4a1e-8890-5020fd2c2f20 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:11.539500 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5dedbef2-19d2-4a1e-8890-5020fd2c2f20 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:11.633035 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-17200a13-d5af-4167-a5c5-72a4b79261c0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:11.633627 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-17200a13-d5af-4167-a5c5-72a4b79261c0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:11.640192 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-17200a13-d5af-4167-a5c5-72a4b79261c0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:11.640936 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-17200a13-d5af-4167-a5c5-72a4b79261c0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:11.641775 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-17200a13-d5af-4167-a5c5-72a4b79261c0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:11.642128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-17200a13-d5af-4167-a5c5-72a4b79261c0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:11.689683 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-5dedbef2-19d2-4a1e-8890-5020fd2c2f20 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:11.701755 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5dedbef2-19d2-4a1e-8890-5020fd2c2f20 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1757 microversion: 2.1 time: 0.176085 Jun 06 21:15:11.703135 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 508/977] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:11 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:11.865889 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-17200a13-d5af-4167-a5c5-72a4b79261c0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:11.873873 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-17200a13-d5af-4167-a5c5-72a4b79261c0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1673 microversion: 2.1 time: 0.245663 Jun 06 21:15:11.874459 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 470/978] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:11 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1673 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:15:12.461904 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-b394f2ea-c29d-4835-bee6-f68b4ec99b53 req-741eb273-2d45-4a27-8a85-cc782e515a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce90b0bc-be67-4862-bac1-77835f2d7a0f", "name": "network-vif-deleted", "tag": "fdfd6105-6b85-48fb-93c4-8ad8cf48940d"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:15:12.470493 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-b394f2ea-c29d-4835-bee6-f68b4ec99b53 req-741eb273-2d45-4a27-8a85-cc782e515a98 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:12.471091 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-b394f2ea-c29d-4835-bee6-f68b4ec99b53 req-741eb273-2d45-4a27-8a85-cc782e515a98 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:12.484108 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-b394f2ea-c29d-4835-bee6-f68b4ec99b53 req-741eb273-2d45-4a27-8a85-cc782e515a98 service nova] Creating event network-vif-deleted:fdfd6105-6b85-48fb-93c4-8ad8cf48940d for instance ce90b0bc-be67-4862-bac1-77835f2d7a0f on hv-cinder-84488 Jun 06 21:15:12.489664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-b394f2ea-c29d-4835-bee6-f68b4ec99b53 req-741eb273-2d45-4a27-8a85-cc782e515a98 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031720 Jun 06 21:15:12.490459 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 509/979] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:15:12.723638 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-6600d4b0-bf4f-4e5d-8ee5-866bbdd426ee tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:12.724463 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-6600d4b0-bf4f-4e5d-8ee5-866bbdd426ee tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:12.732590 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6600d4b0-bf4f-4e5d-8ee5-866bbdd426ee tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:12.733089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6600d4b0-bf4f-4e5d-8ee5-866bbdd426ee tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:12.733884 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6600d4b0-bf4f-4e5d-8ee5-866bbdd426ee tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:12.734350 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6600d4b0-bf4f-4e5d-8ee5-866bbdd426ee tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:12.893175 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-6600d4b0-bf4f-4e5d-8ee5-866bbdd426ee tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:12.895885 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-aceb7bdf-4600-4abc-879d-081bf0b408c3 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:12.897190 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-aceb7bdf-4600-4abc-879d-081bf0b408c3 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:12.903047 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-6600d4b0-bf4f-4e5d-8ee5-866bbdd426ee tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1760 microversion: 2.1 time: 0.183984 Jun 06 21:15:12.903391 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aceb7bdf-4600-4abc-879d-081bf0b408c3 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:12.914842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 471/980] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:12 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1760 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:12.916519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aceb7bdf-4600-4abc-879d-081bf0b408c3 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:12.917629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aceb7bdf-4600-4abc-879d-081bf0b408c3 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:12.918296 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aceb7bdf-4600-4abc-879d-081bf0b408c3 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:12.951909 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aceb7bdf-4600-4abc-879d-081bf0b408c3 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:12.952626 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-aceb7bdf-4600-4abc-879d-081bf0b408c3 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:12.953290 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-aceb7bdf-4600-4abc-879d-081bf0b408c3 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lazy-loading 'fault' on Instance uuid ce90b0bc-be67-4862-bac1-77835f2d7a0f {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:15:13.003628 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-aceb7bdf-4600-4abc-879d-081bf0b408c3 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:13.011787 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-aceb7bdf-4600-4abc-879d-081bf0b408c3 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 200 len: 1328 microversion: 2.1 time: 0.120516 Jun 06 21:15:13.012414 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 510/981] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:12 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 1328 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:14.031455 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-1835a656-b52e-455e-a084-ab58523a27ad tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:14.032105 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-1835a656-b52e-455e-a084-ab58523a27ad tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:14.039962 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1835a656-b52e-455e-a084-ab58523a27ad tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:14.040446 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1835a656-b52e-455e-a084-ab58523a27ad tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:14.041231 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1835a656-b52e-455e-a084-ab58523a27ad tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:14.041661 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-1835a656-b52e-455e-a084-ab58523a27ad tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:14.056945 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-1835a656-b52e-455e-a084-ab58523a27ad tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] HTTP exception thrown: Instance ce90b0bc-be67-4862-bac1-77835f2d7a0f could not be found. Jun 06 21:15:14.058732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-1835a656-b52e-455e-a084-ab58523a27ad tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Request method failure captured: Jun 06 21:15:14.058732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f HTTP/1.1 Jun 06 21:15:14.058732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:15:14.058732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:15:14.058732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:15:14.058732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 0 Jun 06 21:15:14.058732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:15:14.058732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:15:14.058732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:15:14.058732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:15:14.058732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinm2cOSEcezPPrBFaIH2SDs1Uc5aZF68gyqD8c8M5iTw8oHPVDA8Jh3_HvjLQ_ptyQRZLl0DWMuZz62Z_NDjpbGhHxdHcvzbuuknSsp8HS8vkFQE5s9Z7NrzTXKMAQb4vZEIk3XGBPjk_s5W3wPOZMskC9kwvlOMLCppWlZI3xg6T2-o Jun 06 21:15:14.058732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:15:14.058732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:15:14.058732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:15:14.058732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:15:14.058732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:15:14.058732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:15:14.058732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: ce7fbb51b32d4342a7b06db4199b5638 Jun 06 21:15:14.058732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-AttachVolumeTestJSON-459007962 Jun 06 21:15:14.058732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:15:14.058732 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:15:14.060246 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:15:14.060246 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-AttachVolumeTestJSON-459007962 Jun 06 21:15:14.060246 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: ce7fbb51b32d4342a7b06db4199b5638 Jun 06 21:15:14.060246 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-AttachVolumeTestJSON-459007962 Jun 06 21:15:14.060246 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-AttachVolumeTestJSON-459007962-project Jun 06 21:15:14.060246 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:15:14.060246 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:15:14.060246 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: 0ecf39d671ac4f52be5dd80a5ec55615 Jun 06 21:15:14.060246 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-AttachVolumeTestJSON-459007962-project Jun 06 21:15:14.060246 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: > Jun 06 21:15:14.060246 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Instance ce90b0bc-be67-4862-bac1-77835f2d7a0f could not be found. Jun 06 21:15:14.060246 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'id': 'ce90b0bc-be67-4862-bac1-77835f2d7a0f'} Jun 06 21:15:14.061108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:15:14.061108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:15:14.061108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:15:14.061108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:15:14.061108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:15:14.061108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:15:14.061108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:15:14.061108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:15:14.061108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:15:14.061108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:15:14.061108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce90b0bc-be67-4862-bac1-77835f2d7a0f could not be found. Jun 06 21:15:14.061108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:15:14.061108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:15:14.061108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:15:14.061108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:15:14.061108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:15:14.061108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:15:14.061108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:15:14.061108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:15:14.061108 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:15:14.062442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:15:14.062442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:15:14.062442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:15:14.062442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:15:14.062442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:15:14.062442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:15:14.062442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:15:14.062442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce90b0bc-be67-4862-bac1-77835f2d7a0f could not be found. Jun 06 21:15:14.062442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:15:14.062442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:15:14.062442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:15:14.062442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:15:14.062442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:15:14.062442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:15:14.062442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:15:14.062442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:15:14.062442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce90b0bc-be67-4862-bac1-77835f2d7a0f could not be found. Jun 06 21:15:14.062442 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:15:14.063667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-1835a656-b52e-455e-a084-ab58523a27ad tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Returning 404 to user: Instance ce90b0bc-be67-4862-bac1-77835f2d7a0f could not be found. {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:15:14.063667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-1835a656-b52e-455e-a084-ab58523a27ad tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 404 len: 111 microversion: 2.1 time: 0.034465 Jun 06 21:15:14.063667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 472/982] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:14 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:15:14.070011 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-358ce4e4-17e7-4a65-8671-b638e17ecff0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '.version_select at 0x7f27255f91f0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:14.090628 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-358ce4e4-17e7-4a65-8671-b638e17ecff0 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1570763782" status: 202 len: 0 microversion: 2.1 time: 0.024715 Jun 06 21:15:14.091186 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 511/983] 10.222.0.33 () {58 vars in 1220 bytes} [Mon Jun 6 21:15:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1570763782 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:15:14.773587 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-ff49a5ea-07c9-47af-9601-d3b147d4dab5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Action: 'create', calling method: .version_select at 0x7f27260b3700>, body: {"keypair": {"name": "tempest-keypair-468921441", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNfLP/qUtMg1XgYjwd2KQ+G7XTOm3aWjbni3EWZ32yPZYQQ92sZ/rU09GXydk9G3mM25LfWvWw+bISKzlR7k/7ayfwA5j181xirRknLHwgPv84Bdgy28dHhe3983nR5QA=="}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:15:14.788356 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-ff49a5ea-07c9-47af-9601-d3b147d4dab5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Getting quotas for project ce7fbb51b32d4342a7b06db4199b5638. Resources: {'key_pairs'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:15:14.792404 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-ff49a5ea-07c9-47af-9601-d3b147d4dab5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Getting quotas for user 0ecf39d671ac4f52be5dd80a5ec55615 and project ce7fbb51b32d4342a7b06db4199b5638. Resources: {'key_pairs'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:15:14.817722 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-ff49a5ea-07c9-47af-9601-d3b147d4dab5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048286 Jun 06 21:15:14.818361 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 473/984] 10.222.0.33 () {60 vars in 1158 bytes} [Mon Jun 6 21:15:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:15:16.194953 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5ab21eb2-2e2a-4322-a603-50dea809e8f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1282672307", "imageRef": "e4266a01-7d22-4036-91e8-3ec50e3369c1", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c6fc44ae-ef2f-46ec-8b82-c29866d88b50"}], "security_groups": [{"name": "tempest-securitygroup--1711060515"}], "key_name": "tempest-keypair-468921441", "user_data": "}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:15:16.317210 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.network.neutron [None req-5ab21eb2-2e2a-4322-a603-50dea809e8f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] validate_networks() for [('c6fc44ae-ef2f-46ec-8b82-c29866d88b50', None, None, None, None, None)] {{(pid=117859) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 21:15:16.715338 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-5ab21eb2-2e2a-4322-a603-50dea809e8f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Flavor limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 21:15:16.715736 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-5ab21eb2-2e2a-4322-a603-50dea809e8f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Image limits 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 21:15:16.716418 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-5ab21eb2-2e2a-4322-a603-50dea809e8f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Flavor pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 21:15:16.716829 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-5ab21eb2-2e2a-4322-a603-50dea809e8f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Image pref 0:0:0 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 21:15:16.717211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.virt.hardware [None req-5ab21eb2-2e2a-4322-a603-50dea809e8f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117859) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 21:15:16.727130 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5ab21eb2-2e2a-4322-a603-50dea809e8f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:16.727551 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5ab21eb2-2e2a-4322-a603-50dea809e8f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:16.728424 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5ab21eb2-2e2a-4322-a603-50dea809e8f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:16.728833 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5ab21eb2-2e2a-4322-a603-50dea809e8f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:16.746737 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-5ab21eb2-2e2a-4322-a603-50dea809e8f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Getting quotas for project ce7fbb51b32d4342a7b06db4199b5638. Resources: {'ram', 'cores', 'instances'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:15:16.751344 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.quota [None req-5ab21eb2-2e2a-4322-a603-50dea809e8f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Getting quotas for user 0ecf39d671ac4f52be5dd80a5ec55615 and project ce7fbb51b32d4342a7b06db4199b5638. Resources: {'ram', 'cores', 'instances'} {{(pid=117859) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:15:16.762898 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5ab21eb2-2e2a-4322-a603-50dea809e8f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Going to run 1 instances... {{(pid=117859) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 21:15:16.765246 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5ab21eb2-2e2a-4322-a603-50dea809e8f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4266a01-7d22-4036-91e8-3ec50e3369c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117859) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 21:15:16.816048 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5ab21eb2-2e2a-4322-a603-50dea809e8f1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.626028 Jun 06 21:15:16.816700 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 512/985] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 6 21:15:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 21:15:16.828382 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-257e8ed5-7903-4130-9ba3-89b737365347 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:16.829704 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-257e8ed5-7903-4130-9ba3-89b737365347 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:16.889065 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-257e8ed5-7903-4130-9ba3-89b737365347 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:16.895760 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-257e8ed5-7903-4130-9ba3-89b737365347 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f" status: 200 len: 1237 microversion: 2.1 time: 0.072371 Jun 06 21:15:16.896506 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 474/986] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:16 2022] GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 21:15:17.915122 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e6aa92f2-c276-43ff-9c54-cff2bd4c008c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:17.916537 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e6aa92f2-c276-43ff-9c54-cff2bd4c008c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:17.923564 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e6aa92f2-c276-43ff-9c54-cff2bd4c008c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:17.924033 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e6aa92f2-c276-43ff-9c54-cff2bd4c008c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:17.924811 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e6aa92f2-c276-43ff-9c54-cff2bd4c008c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:17.925236 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e6aa92f2-c276-43ff-9c54-cff2bd4c008c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:18.008095 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e6aa92f2-c276-43ff-9c54-cff2bd4c008c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:18.015614 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e6aa92f2-c276-43ff-9c54-cff2bd4c008c tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f" status: 200 len: 1289 microversion: 2.1 time: 0.105646 Jun 06 21:15:18.016232 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 513/987] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:17 2022] GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f => generated 1289 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:19.034397 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-234d85f0-4a6d-410f-8a11-4f140bcc16b6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:19.035150 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-234d85f0-4a6d-410f-8a11-4f140bcc16b6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:19.044678 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-234d85f0-4a6d-410f-8a11-4f140bcc16b6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:19.045211 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-234d85f0-4a6d-410f-8a11-4f140bcc16b6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:19.046094 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-234d85f0-4a6d-410f-8a11-4f140bcc16b6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:19.046641 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-234d85f0-4a6d-410f-8a11-4f140bcc16b6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:19.328409 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-234d85f0-4a6d-410f-8a11-4f140bcc16b6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:19.336933 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-234d85f0-4a6d-410f-8a11-4f140bcc16b6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f" status: 200 len: 1363 microversion: 2.1 time: 0.306365 Jun 06 21:15:19.337523 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 475/988] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:19 2022] GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f => generated 1363 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:19.771628 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-220dcd3d-9042-40de-aeb4-6db10d11cb12 req-3c28c75b-ebed-45b4-a96f-7114874333ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c69a09-a44d-4656-9aff-38a2beabff4f", "tag": "7eef49e8-52f0-4c02-a5f1-955c7165e6bd"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:15:19.788600 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-220dcd3d-9042-40de-aeb4-6db10d11cb12 req-3c28c75b-ebed-45b4-a96f-7114874333ea service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:19.798016 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-220dcd3d-9042-40de-aeb4-6db10d11cb12 req-3c28c75b-ebed-45b4-a96f-7114874333ea service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:19.812970 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-220dcd3d-9042-40de-aeb4-6db10d11cb12 req-3c28c75b-ebed-45b4-a96f-7114874333ea service nova] Creating event network-changed:7eef49e8-52f0-4c02-a5f1-955c7165e6bd for instance 95c69a09-a44d-4656-9aff-38a2beabff4f on hv-cinder-84488 Jun 06 21:15:19.819325 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-220dcd3d-9042-40de-aeb4-6db10d11cb12 req-3c28c75b-ebed-45b4-a96f-7114874333ea service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051842 Jun 06 21:15:19.820700 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 514/989] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:15:20.354794 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-49d302e4-8aa6-4e42-89d8-f9ea4d7f9792 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:20.355354 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-49d302e4-8aa6-4e42-89d8-f9ea4d7f9792 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:20.362298 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-49d302e4-8aa6-4e42-89d8-f9ea4d7f9792 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:20.362751 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-49d302e4-8aa6-4e42-89d8-f9ea4d7f9792 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:20.363513 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-49d302e4-8aa6-4e42-89d8-f9ea4d7f9792 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:20.363955 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-49d302e4-8aa6-4e42-89d8-f9ea4d7f9792 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:20.500132 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-49d302e4-8aa6-4e42-89d8-f9ea4d7f9792 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:20.508340 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-49d302e4-8aa6-4e42-89d8-f9ea4d7f9792 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f" status: 200 len: 1363 microversion: 2.1 time: 0.157800 Jun 06 21:15:20.508894 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 476/990] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:20 2022] GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:21.531787 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e16dffe9-6115-4815-9aa4-df5015a10bab tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:21.532527 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e16dffe9-6115-4815-9aa4-df5015a10bab tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:21.539786 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e16dffe9-6115-4815-9aa4-df5015a10bab tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:21.540268 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e16dffe9-6115-4815-9aa4-df5015a10bab tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:21.541075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e16dffe9-6115-4815-9aa4-df5015a10bab tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:21.541511 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e16dffe9-6115-4815-9aa4-df5015a10bab tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:21.691262 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e16dffe9-6115-4815-9aa4-df5015a10bab tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:21.700781 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e16dffe9-6115-4815-9aa4-df5015a10bab tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f" status: 200 len: 1363 microversion: 2.1 time: 0.179046 Jun 06 21:15:21.701368 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 515/991] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:21 2022] GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:22.722998 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-09707b80-44a9-415c-8045-a716b9c18bc5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:22.723663 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-09707b80-44a9-415c-8045-a716b9c18bc5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:22.733013 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-09707b80-44a9-415c-8045-a716b9c18bc5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:22.733619 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-09707b80-44a9-415c-8045-a716b9c18bc5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:22.734618 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-09707b80-44a9-415c-8045-a716b9c18bc5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:22.735038 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-09707b80-44a9-415c-8045-a716b9c18bc5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:22.755200 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:15:22.868023 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-09707b80-44a9-415c-8045-a716b9c18bc5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:22.875617 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-09707b80-44a9-415c-8045-a716b9c18bc5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f" status: 200 len: 1363 microversion: 2.1 time: 0.158756 Jun 06 21:15:22.876212 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 477/992] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:22 2022] GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:23.892630 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f2803cc8-bfb6-48ca-8797-203f5e7758f7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:23.893262 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f2803cc8-bfb6-48ca-8797-203f5e7758f7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:23.895730 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:15:23.901318 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f2803cc8-bfb6-48ca-8797-203f5e7758f7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:23.901766 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f2803cc8-bfb6-48ca-8797-203f5e7758f7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:23.902532 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f2803cc8-bfb6-48ca-8797-203f5e7758f7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:23.902963 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f2803cc8-bfb6-48ca-8797-203f5e7758f7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:23.906444 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:15:24.040214 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-f2803cc8-bfb6-48ca-8797-203f5e7758f7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:24.048323 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f2803cc8-bfb6-48ca-8797-203f5e7758f7 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f" status: 200 len: 1363 microversion: 2.1 time: 0.159581 Jun 06 21:15:24.049130 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 516/993] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:23 2022] GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:24.136793 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-8f4d4e48-2136-4fcb-b464-1ca784bb4e8f req-3c23dbe4-0429-4354-883e-34855c34f3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c69a09-a44d-4656-9aff-38a2beabff4f", "name": "network-vif-plugged", "status": "completed", "tag": "7eef49e8-52f0-4c02-a5f1-955c7165e6bd"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:15:24.140728 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:15:24.146788 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-8f4d4e48-2136-4fcb-b464-1ca784bb4e8f req-3c23dbe4-0429-4354-883e-34855c34f3a3 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:24.147298 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-8f4d4e48-2136-4fcb-b464-1ca784bb4e8f req-3c23dbe4-0429-4354-883e-34855c34f3a3 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:24.161848 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-8f4d4e48-2136-4fcb-b464-1ca784bb4e8f req-3c23dbe4-0429-4354-883e-34855c34f3a3 service nova] Creating event network-vif-plugged:7eef49e8-52f0-4c02-a5f1-955c7165e6bd for instance 95c69a09-a44d-4656-9aff-38a2beabff4f on hv-cinder-84488 Jun 06 21:15:24.167255 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-8f4d4e48-2136-4fcb-b464-1ca784bb4e8f req-3c23dbe4-0429-4354-883e-34855c34f3a3 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034141 Jun 06 21:15:24.168007 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 478/994] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:15:25.068658 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-4dd1252f-0ec7-4f7f-86cc-669bb9d11cb9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:25.069407 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-4dd1252f-0ec7-4f7f-86cc-669bb9d11cb9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:25.076434 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4dd1252f-0ec7-4f7f-86cc-669bb9d11cb9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:25.076883 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4dd1252f-0ec7-4f7f-86cc-669bb9d11cb9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:25.077994 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4dd1252f-0ec7-4f7f-86cc-669bb9d11cb9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:25.078414 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-4dd1252f-0ec7-4f7f-86cc-669bb9d11cb9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:25.220109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-4dd1252f-0ec7-4f7f-86cc-669bb9d11cb9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:25.228733 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-4dd1252f-0ec7-4f7f-86cc-669bb9d11cb9 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f" status: 200 len: 1363 microversion: 2.1 time: 0.166347 Jun 06 21:15:25.229308 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 517/995] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:25 2022] GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:26.247539 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b47f19b7-5fad-4231-9f1b-c2b756a2781f tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:26.248363 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-b47f19b7-5fad-4231-9f1b-c2b756a2781f tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:26.255198 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b47f19b7-5fad-4231-9f1b-c2b756a2781f tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:26.255667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b47f19b7-5fad-4231-9f1b-c2b756a2781f tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:26.256515 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b47f19b7-5fad-4231-9f1b-c2b756a2781f tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:26.256972 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-b47f19b7-5fad-4231-9f1b-c2b756a2781f tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:26.400317 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-b47f19b7-5fad-4231-9f1b-c2b756a2781f tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:26.408226 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-b47f19b7-5fad-4231-9f1b-c2b756a2781f tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f" status: 200 len: 1548 microversion: 2.1 time: 0.166024 Jun 06 21:15:26.408800 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 479/996] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:26 2022] GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:26.424658 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e28f212b-1669-446e-a10b-ab9943519bc6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:26.425211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e28f212b-1669-446e-a10b-ab9943519bc6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:26.432574 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e28f212b-1669-446e-a10b-ab9943519bc6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:26.433019 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e28f212b-1669-446e-a10b-ab9943519bc6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:26.433780 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e28f212b-1669-446e-a10b-ab9943519bc6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:26.434210 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e28f212b-1669-446e-a10b-ab9943519bc6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:26.516599 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e28f212b-1669-446e-a10b-ab9943519bc6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095505 Jun 06 21:15:26.517280 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 518/997] 10.222.0.33 () {58 vars in 1274 bytes} [Mon Jun 6 21:15:26 2022] GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:15:27.778269 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=6 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:15:27.841182 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-dc3ad394-6c26-48a7-9e34-5e681edc18d1 req-40e90686-47a4-4f38-bdb0-42070e6214a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c69a09-a44d-4656-9aff-38a2beabff4f", "tag": "7eef49e8-52f0-4c02-a5f1-955c7165e6bd"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:15:27.849198 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-dc3ad394-6c26-48a7-9e34-5e681edc18d1 req-40e90686-47a4-4f38-bdb0-42070e6214a0 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:27.849635 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-dc3ad394-6c26-48a7-9e34-5e681edc18d1 req-40e90686-47a4-4f38-bdb0-42070e6214a0 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:27.861099 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-dc3ad394-6c26-48a7-9e34-5e681edc18d1 req-40e90686-47a4-4f38-bdb0-42070e6214a0 service nova] Creating event network-changed:7eef49e8-52f0-4c02-a5f1-955c7165e6bd for instance 95c69a09-a44d-4656-9aff-38a2beabff4f on hv-cinder-84488 Jun 06 21:15:27.866148 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-dc3ad394-6c26-48a7-9e34-5e681edc18d1 req-40e90686-47a4-4f38-bdb0-42070e6214a0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092566 Jun 06 21:15:27.867191 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 480/998] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:15:46.113184 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:15:46.113986 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=6 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:15:46.115396 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=5 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:15:46.116179 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=15 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:15:46.122141 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-572e54ca-1308-442b-ac1a-d790a431af0b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-760339005"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:15:46.122717 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-572e54ca-1308-442b-ac1a-d790a431af0b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:46.131282 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-572e54ca-1308-442b-ac1a-d790a431af0b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:46.131789 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-572e54ca-1308-442b-ac1a-d790a431af0b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:46.132594 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-572e54ca-1308-442b-ac1a-d790a431af0b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:46.133031 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-572e54ca-1308-442b-ac1a-d790a431af0b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:46.278008 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.network.security_group_api [None req-572e54ca-1308-442b-ac1a-d790a431af0b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Removing security group a8c0c7de-10cb-49a0-9d64-0e554af47eda from port 38f344f4-4c2f-4d38-874b-72005dc25e05 Jun 06 21:15:46.685499 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-572e54ca-1308-442b-ac1a-d790a431af0b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "POST /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887/action" status: 202 len: 0 microversion: 2.1 time: 0.571916 Jun 06 21:15:46.686857 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 519/999] 10.222.0.33 () {60 vars in 1277 bytes} [Mon Jun 6 21:15:46 2022] POST /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:15:46.690358 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=5 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:15:46.691006 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=12 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:15:46.695283 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-da416e4e-c663-4a8e-9b06-bc08a5f2b2ef req-45bd5bbc-2579-4caf-b0d5-38c84804cc44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7fe5e83-abc4-4dd8-b0db-8360ba722887", "tag": "38f344f4-4c2f-4d38-874b-72005dc25e05"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:15:46.712975 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-da416e4e-c663-4a8e-9b06-bc08a5f2b2ef req-45bd5bbc-2579-4caf-b0d5-38c84804cc44 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:46.714602 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-da416e4e-c663-4a8e-9b06-bc08a5f2b2ef req-45bd5bbc-2579-4caf-b0d5-38c84804cc44 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:46.746589 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-da416e4e-c663-4a8e-9b06-bc08a5f2b2ef req-45bd5bbc-2579-4caf-b0d5-38c84804cc44 service nova] Creating event network-changed:38f344f4-4c2f-4d38-874b-72005dc25e05 for instance d7fe5e83-abc4-4dd8-b0db-8360ba722887 on hv-cinder-84488 Jun 06 21:15:46.752487 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-da416e4e-c663-4a8e-9b06-bc08a5f2b2ef req-45bd5bbc-2579-4caf-b0d5-38c84804cc44 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063846 Jun 06 21:15:46.753891 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 481/1000] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:15:47.993818 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5b416fe6-925f-4048-a160-0a97f734e68b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:47.994417 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-5b416fe6-925f-4048-a160-0a97f734e68b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:48.002353 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5b416fe6-925f-4048-a160-0a97f734e68b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:48.002790 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5b416fe6-925f-4048-a160-0a97f734e68b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:48.003558 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5b416fe6-925f-4048-a160-0a97f734e68b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:48.004023 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-5b416fe6-925f-4048-a160-0a97f734e68b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:48.108304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-5b416fe6-925f-4048-a160-0a97f734e68b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lazy-loading 'services' on Instance uuid d7fe5e83-abc4-4dd8-b0db-8360ba722887 {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:15:48.185344 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5b416fe6-925f-4048-a160-0a97f734e68b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887/os-volume_attachments/fdc4baaf-2ab3-4685-beac-a5215e00e613" status: 202 len: 0 microversion: 2.1 time: 0.195922 Jun 06 21:15:48.185968 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 520/1001] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 6 21:15:47 2022] DELETE /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887/os-volume_attachments/fdc4baaf-2ab3-4685-beac-a5215e00e613 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:15:48.195730 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2e9e1aaf-e4d8-4530-b647-cd6c41b8a585 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:48.196881 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-2e9e1aaf-e4d8-4530-b647-cd6c41b8a585 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:48.203949 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2e9e1aaf-e4d8-4530-b647-cd6c41b8a585 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:48.204715 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2e9e1aaf-e4d8-4530-b647-cd6c41b8a585 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:48.205678 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2e9e1aaf-e4d8-4530-b647-cd6c41b8a585 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:48.206102 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2e9e1aaf-e4d8-4530-b647-cd6c41b8a585 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:48.238853 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-2e9e1aaf-e4d8-4530-b647-cd6c41b8a585 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047934 Jun 06 21:15:48.239440 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 482/1002] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 6 21:15:48 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:15:48.768272 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-0437f7c4-4cfa-485f-b59c-332c25922bb9 req-7fef53f1-a4df-4407-a26a-07ba11cec501 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7fe5e83-abc4-4dd8-b0db-8360ba722887", "tag": "38f344f4-4c2f-4d38-874b-72005dc25e05"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:15:48.778972 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-0437f7c4-4cfa-485f-b59c-332c25922bb9 req-7fef53f1-a4df-4407-a26a-07ba11cec501 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:48.779411 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-0437f7c4-4cfa-485f-b59c-332c25922bb9 req-7fef53f1-a4df-4407-a26a-07ba11cec501 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:48.794801 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-0437f7c4-4cfa-485f-b59c-332c25922bb9 req-7fef53f1-a4df-4407-a26a-07ba11cec501 service nova] Creating event network-changed:38f344f4-4c2f-4d38-874b-72005dc25e05 for instance d7fe5e83-abc4-4dd8-b0db-8360ba722887 on hv-cinder-84488 Jun 06 21:15:48.800324 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-0437f7c4-4cfa-485f-b59c-332c25922bb9 req-7fef53f1-a4df-4407-a26a-07ba11cec501 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036158 Jun 06 21:15:48.801146 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 521/1003] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:15:49.251748 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-8b364e28-c254-45f5-9cda-3779d33dac61 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:49.252842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-8b364e28-c254-45f5-9cda-3779d33dac61 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:49.260619 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8b364e28-c254-45f5-9cda-3779d33dac61 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:49.261038 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8b364e28-c254-45f5-9cda-3779d33dac61 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:49.261928 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8b364e28-c254-45f5-9cda-3779d33dac61 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:49.262377 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8b364e28-c254-45f5-9cda-3779d33dac61 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:49.295921 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-8b364e28-c254-45f5-9cda-3779d33dac61 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048041 Jun 06 21:15:49.295921 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 483/1004] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 6 21:15:49 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 21:15:49.307155 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-61100a27-9667-430f-997b-8802e142e49e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:49.307785 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-61100a27-9667-430f-997b-8802e142e49e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:49.315086 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61100a27-9667-430f-997b-8802e142e49e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:49.315412 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61100a27-9667-430f-997b-8802e142e49e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:49.316225 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61100a27-9667-430f-997b-8802e142e49e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:49.316662 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-61100a27-9667-430f-997b-8802e142e49e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:49.401126 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-61100a27-9667-430f-997b-8802e142e49e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] HTTP exception thrown: Instance d7fe5e83-abc4-4dd8-b0db-8360ba722887 is not attached to volume fdc4baaf-2ab3-4685-beac-a5215e00e613 Jun 06 21:15:49.411664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-61100a27-9667-430f-997b-8802e142e49e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Request method failure captured: Jun 06 21:15:49.411664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: DELETE /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887/os-volume_attachments/fdc4baaf-2ab3-4685-beac-a5215e00e613 HTTP/1.1 Jun 06 21:15:49.411664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:15:49.411664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:15:49.411664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:15:49.411664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:15:49.411664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:15:49.411664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:15:49.411664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:15:49.411664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:15:49.411664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinm4HIDxEH5SHFdvaymkmN7LkseCNDKoH1I7ArW-86Vga-alccNTGtiMxPqWBmgFpX5UybHdvVTgynCAMNAL1Kf6l3BGkuXPtH_goUHatyghvAWhn3FWeU18_XAomfmleGenCKJ7RXHFHTcIxJRE7gljNCxUYiqw8eY-9rHvF_3juSzQ Jun 06 21:15:49.411664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:15:49.411664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:15:49.411664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:15:49.411664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:15:49.411664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:15:49.411664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:15:49.411664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: d768129e58ea4e4bb4cb2da9a11da521 Jun 06 21:15:49.411664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-TestMinimumBasicScenario-303776842 Jun 06 21:15:49.411664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:15:49.411664 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:15:49.413638 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d768129e58ea4e4bb4cb2da9a11da521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d768129e58ea4e4bb4cb2da9a11da521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d768129e58ea4e4bb4cb2da9a11da521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d768129e58ea4e4bb4cb2da9a11da521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:15:49.413638 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-TestMinimumBasicScenario-303776842 Jun 06 21:15:49.413638 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: d768129e58ea4e4bb4cb2da9a11da521 Jun 06 21:15:49.413638 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-TestMinimumBasicScenario-303776842 Jun 06 21:15:49.413638 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-TestMinimumBasicScenario-303776842-project Jun 06 21:15:49.413638 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:15:49.413638 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:15:49.413638 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: 941d5887422e439a8196fc8b38c3f890 Jun 06 21:15:49.413638 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-TestMinimumBasicScenario-303776842-project Jun 06 21:15:49.413638 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: > Jun 06 21:15:49.413638 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Instance d7fe5e83-abc4-4dd8-b0db-8360ba722887 is not attached to volume fdc4baaf-2ab3-4685-beac-a5215e00e613 Jun 06 21:15:49.414462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'server_id': 'd7fe5e83-abc4-4dd8-b0db-8360ba722887', 'id': 'fdc4baaf-2ab3-4685-beac-a5215e00e613'} Jun 06 21:15:49.414462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:15:49.414462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:15:49.414462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 06 21:15:49.414462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 06 21:15:49.414462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 21:15:49.414462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 21:15:49.414462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 06 21:15:49.414462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 06 21:15:49.414462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fdc4baaf-2ab3-4685-beac-a5215e00e613. Jun 06 21:15:49.414462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:15:49.414462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:15:49.414462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:15:49.414462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:15:49.414462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:15:49.414462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:15:49.414462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:15:49.414462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:15:49.414462 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:15:49.415773 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:15:49.415773 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 06 21:15:49.415773 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 06 21:15:49.415773 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7fe5e83-abc4-4dd8-b0db-8360ba722887 is not attached to volume fdc4baaf-2ab3-4685-beac-a5215e00e613 Jun 06 21:15:49.415773 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:15:49.415773 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:15:49.415773 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:15:49.415773 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:15:49.415773 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:15:49.415773 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:15:49.415773 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:15:49.415773 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:15:49.415773 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7fe5e83-abc4-4dd8-b0db-8360ba722887 is not attached to volume fdc4baaf-2ab3-4685-beac-a5215e00e613 Jun 06 21:15:49.415773 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:15:49.415773 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-61100a27-9667-430f-997b-8802e142e49e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Returning 404 to user: Instance d7fe5e83-abc4-4dd8-b0db-8360ba722887 is not attached to volume fdc4baaf-2ab3-4685-beac-a5215e00e613 {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:15:49.416943 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-61100a27-9667-430f-997b-8802e142e49e tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887/os-volume_attachments/fdc4baaf-2ab3-4685-beac-a5215e00e613" status: 404 len: 154 microversion: 2.1 time: 0.110923 Jun 06 21:15:49.416943 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 522/1005] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 6 21:15:49 2022] DELETE /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887/os-volume_attachments/fdc4baaf-2ab3-4685-beac-a5215e00e613 => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:15:50.565712 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-3e71dd8a-016e-43a2-b684-bf02b2eee49b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:50.566276 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-3e71dd8a-016e-43a2-b684-bf02b2eee49b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:50.573807 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3e71dd8a-016e-43a2-b684-bf02b2eee49b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:50.574258 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3e71dd8a-016e-43a2-b684-bf02b2eee49b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:50.575024 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3e71dd8a-016e-43a2-b684-bf02b2eee49b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:50.575580 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-3e71dd8a-016e-43a2-b684-bf02b2eee49b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:50.603469 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-3e71dd8a-016e-43a2-b684-bf02b2eee49b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Going to try to terminate instance {{(pid=117860) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 21:15:50.686033 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-3e71dd8a-016e-43a2-b684-bf02b2eee49b tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "DELETE /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 204 len: 0 microversion: 2.1 time: 0.123857 Jun 06 21:15:50.686609 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 484/1006] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:15:50 2022] DELETE /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 21:15:50.695427 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2e22108e-c970-49ea-8ebc-0b64ebeec056 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:50.696053 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2e22108e-c970-49ea-8ebc-0b64ebeec056 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:50.703396 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e22108e-c970-49ea-8ebc-0b64ebeec056 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:50.703840 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e22108e-c970-49ea-8ebc-0b64ebeec056 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:50.704628 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e22108e-c970-49ea-8ebc-0b64ebeec056 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:50.705054 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2e22108e-c970-49ea-8ebc-0b64ebeec056 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:50.843348 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-2e22108e-c970-49ea-8ebc-0b64ebeec056 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:50.851410 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2e22108e-c970-49ea-8ebc-0b64ebeec056 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1555 microversion: 2.1 time: 0.159869 Jun 06 21:15:50.851961 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 523/1007] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:50 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:51.870117 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-ec79a9ba-393c-425c-ab6a-ac67864ec677 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:51.870970 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-ec79a9ba-393c-425c-ab6a-ac67864ec677 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:51.877915 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ec79a9ba-393c-425c-ab6a-ac67864ec677 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:51.878352 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ec79a9ba-393c-425c-ab6a-ac67864ec677 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:51.879113 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ec79a9ba-393c-425c-ab6a-ac67864ec677 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:51.879537 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-ec79a9ba-393c-425c-ab6a-ac67864ec677 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:52.018055 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-ec79a9ba-393c-425c-ab6a-ac67864ec677 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:52.026089 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-ec79a9ba-393c-425c-ab6a-ac67864ec677 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1555 microversion: 2.1 time: 0.160386 Jun 06 21:15:52.026821 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 485/1008] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:51 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:53.044366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-613572a3-1120-4fd0-9581-e5db6539fa76 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:53.044995 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-613572a3-1120-4fd0-9581-e5db6539fa76 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:53.051886 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-613572a3-1120-4fd0-9581-e5db6539fa76 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:53.052568 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-613572a3-1120-4fd0-9581-e5db6539fa76 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:53.053737 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-613572a3-1120-4fd0-9581-e5db6539fa76 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:53.056904 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-613572a3-1120-4fd0-9581-e5db6539fa76 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:53.133620 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-613572a3-1120-4fd0-9581-e5db6539fa76 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '941d5887422e439a8196fc8b38c3f890', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd768129e58ea4e4bb4cb2da9a11da521', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:15:53.143758 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-613572a3-1120-4fd0-9581-e5db6539fa76 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 200 len: 1513 microversion: 2.1 time: 0.103491 Jun 06 21:15:53.144387 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 524/1009] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:53 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 1513 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:15:53.179317 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-0f900e4d-13c3-4632-8b7c-bdbc52430f2f req-4d022631-ff1f-4251-95c3-bf0083b571e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7fe5e83-abc4-4dd8-b0db-8360ba722887", "name": "network-vif-deleted", "tag": "38f344f4-4c2f-4d38-874b-72005dc25e05"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:15:53.188647 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-0f900e4d-13c3-4632-8b7c-bdbc52430f2f req-4d022631-ff1f-4251-95c3-bf0083b571e2 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:53.188647 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-0f900e4d-13c3-4632-8b7c-bdbc52430f2f req-4d022631-ff1f-4251-95c3-bf0083b571e2 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:53.201217 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-0f900e4d-13c3-4632-8b7c-bdbc52430f2f req-4d022631-ff1f-4251-95c3-bf0083b571e2 service nova] Creating event network-vif-deleted:38f344f4-4c2f-4d38-874b-72005dc25e05 for instance d7fe5e83-abc4-4dd8-b0db-8360ba722887 on hv-cinder-84488 Jun 06 21:15:53.206774 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-0f900e4d-13c3-4632-8b7c-bdbc52430f2f req-4d022631-ff1f-4251-95c3-bf0083b571e2 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099826 Jun 06 21:15:53.207399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 486/1010] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 21:15:54.162146 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2faf88dd-ae40-4524-b3bd-97aaab523862 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:54.162765 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-2faf88dd-ae40-4524-b3bd-97aaab523862 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] [instance: d7fe5e83-abc4-4dd8-b0db-8360ba722887] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:15:54.170702 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2faf88dd-ae40-4524-b3bd-97aaab523862 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:54.171159 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2faf88dd-ae40-4524-b3bd-97aaab523862 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:54.171924 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2faf88dd-ae40-4524-b3bd-97aaab523862 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:15:54.172395 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-2faf88dd-ae40-4524-b3bd-97aaab523862 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:15:54.187163 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-2faf88dd-ae40-4524-b3bd-97aaab523862 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] HTTP exception thrown: Instance d7fe5e83-abc4-4dd8-b0db-8360ba722887 could not be found. Jun 06 21:15:54.188747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2faf88dd-ae40-4524-b3bd-97aaab523862 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Request method failure captured: Jun 06 21:15:54.188747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 HTTP/1.1 Jun 06 21:15:54.188747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:15:54.188747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:15:54.188747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:15:54.188747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:15:54.188747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:15:54.188747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:15:54.188747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:15:54.188747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:15:54.188747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinm4HIDxEH5SHFdvaymkmN7LkseCNDKoH1I7ArW-86Vga-alccNTGtiMxPqWBmgFpX5UybHdvVTgynCAMNAL1Kf6l3BGkuXPtH_goUHatyghvAWhn3FWeU18_XAomfmleGenCKJ7RXHFHTcIxJRE7gljNCxUYiqw8eY-9rHvF_3juSzQ Jun 06 21:15:54.188747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:15:54.188747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:15:54.188747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:15:54.188747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:15:54.188747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:15:54.188747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:15:54.188747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: d768129e58ea4e4bb4cb2da9a11da521 Jun 06 21:15:54.188747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-TestMinimumBasicScenario-303776842 Jun 06 21:15:54.188747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:15:54.188747 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:15:54.190435 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d768129e58ea4e4bb4cb2da9a11da521"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_d768129e58ea4e4bb4cb2da9a11da521"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/d768129e58ea4e4bb4cb2da9a11da521"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/d768129e58ea4e4bb4cb2da9a11da521"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:15:54.190435 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-TestMinimumBasicScenario-303776842 Jun 06 21:15:54.190435 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: d768129e58ea4e4bb4cb2da9a11da521 Jun 06 21:15:54.190435 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-TestMinimumBasicScenario-303776842 Jun 06 21:15:54.190435 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-TestMinimumBasicScenario-303776842-project Jun 06 21:15:54.190435 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:15:54.190435 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:15:54.190435 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: 941d5887422e439a8196fc8b38c3f890 Jun 06 21:15:54.190435 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-TestMinimumBasicScenario-303776842-project Jun 06 21:15:54.190435 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: > Jun 06 21:15:54.190435 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Instance d7fe5e83-abc4-4dd8-b0db-8360ba722887 could not be found. Jun 06 21:15:54.190435 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': 'd7fe5e83-abc4-4dd8-b0db-8360ba722887'} Jun 06 21:15:54.191350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:15:54.191350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:15:54.191350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:15:54.191350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:15:54.191350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:15:54.191350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:15:54.191350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:15:54.191350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:15:54.191350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:15:54.191350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:15:54.191350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7fe5e83-abc4-4dd8-b0db-8360ba722887 could not be found. Jun 06 21:15:54.191350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:15:54.191350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:15:54.191350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:15:54.191350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:15:54.191350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:15:54.191350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:15:54.191350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:15:54.191350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:15:54.191350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:15:54.192819 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:15:54.192819 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:15:54.192819 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:15:54.192819 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:15:54.192819 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:15:54.192819 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:15:54.192819 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:15:54.192819 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7fe5e83-abc4-4dd8-b0db-8360ba722887 could not be found. Jun 06 21:15:54.192819 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:15:54.192819 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:15:54.192819 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:15:54.192819 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:15:54.192819 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:15:54.192819 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:15:54.192819 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:15:54.192819 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:15:54.192819 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7fe5e83-abc4-4dd8-b0db-8360ba722887 could not be found. Jun 06 21:15:54.192819 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:15:54.194284 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-2faf88dd-ae40-4524-b3bd-97aaab523862 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Returning 404 to user: Instance d7fe5e83-abc4-4dd8-b0db-8360ba722887 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:15:54.194284 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-2faf88dd-ae40-4524-b3bd-97aaab523862 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887" status: 404 len: 111 microversion: 2.1 time: 0.032590 Jun 06 21:15:54.194284 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 525/1011] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:15:54 2022] GET /compute/v2.1/servers/d7fe5e83-abc4-4dd8-b0db-8360ba722887 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:15:54.200798 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2abc3a4d-2d01-4129-bcc6-14fc92fe6740 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] Calling method '.version_select at 0x7f2726052040>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:15:54.222429 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-2abc3a4d-2d01-4129-bcc6-14fc92fe6740 tempest-TestMinimumBasicScenario-303776842 tempest-TestMinimumBasicScenario-303776842-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1641621869" status: 202 len: 0 microversion: 2.1 time: 0.026536 Jun 06 21:15:54.222972 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 487/1012] 10.222.0.33 () {58 vars in 1271 bytes} [Mon Jun 6 21:15:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1641621869 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:16:04.005168 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-19b1687b-f1bf-4a54-af9b-3e4e3c0deccb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:04.005767 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-19b1687b-f1bf-4a54-af9b-3e4e3c0deccb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:16:04.012829 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-19b1687b-f1bf-4a54-af9b-3e4e3c0deccb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:04.013365 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-19b1687b-f1bf-4a54-af9b-3e4e3c0deccb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:04.014746 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-19b1687b-f1bf-4a54-af9b-3e4e3c0deccb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:04.015181 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-19b1687b-f1bf-4a54-af9b-3e4e3c0deccb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:04.041303 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-19b1687b-f1bf-4a54-af9b-3e4e3c0deccb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/ips" status: 200 len: 145 microversion: 2.1 time: 0.040113 Jun 06 21:16:04.041911 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 526/1013] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jun 6 21:16:03 2022] GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:16:05.395857 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e777cbe2-89af-4bd8-8185-5cd08a6a4145 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba22345f-38aa-420e-b5ed-c973d0f63dcf"}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:16:05.397064 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-e777cbe2-89af-4bd8-8185-5cd08a6a4145 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:16:05.399672 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:05.400333 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:05.407698 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e777cbe2-89af-4bd8-8185-5cd08a6a4145 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:05.408153 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e777cbe2-89af-4bd8-8185-5cd08a6a4145 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:05.408909 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e777cbe2-89af-4bd8-8185-5cd08a6a4145 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:05.409335 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e777cbe2-89af-4bd8-8185-5cd08a6a4145 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:05.684596 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-e777cbe2-89af-4bd8-8185-5cd08a6a4145 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "POST /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292420 Jun 06 21:16:05.685252 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 488/1014] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 6 21:16:05 2022] POST /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-volume_attachments => generated 194 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:16:12.184035 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-1c25e916-7b21-485b-9f55-a8c6d3e701a5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:12.185484 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-1c25e916-7b21-485b-9f55-a8c6d3e701a5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:16:12.192561 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1c25e916-7b21-485b-9f55-a8c6d3e701a5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:12.192928 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1c25e916-7b21-485b-9f55-a8c6d3e701a5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:12.194013 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1c25e916-7b21-485b-9f55-a8c6d3e701a5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:12.194448 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-1c25e916-7b21-485b-9f55-a8c6d3e701a5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:12.226217 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-1c25e916-7b21-485b-9f55-a8c6d3e701a5 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046490 Jun 06 21:16:12.226801 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 527/1015] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 6 21:16:12 2022] GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:16:12.238370 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-6e94e287-3e1e-4286-a5c6-d79b8188a2db tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:12.238952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-6e94e287-3e1e-4286-a5c6-d79b8188a2db tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:16:12.245831 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6e94e287-3e1e-4286-a5c6-d79b8188a2db tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:12.246281 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6e94e287-3e1e-4286-a5c6-d79b8188a2db tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:12.247053 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6e94e287-3e1e-4286-a5c6-d79b8188a2db tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:12.247486 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-6e94e287-3e1e-4286-a5c6-d79b8188a2db tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:12.277519 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-6e94e287-3e1e-4286-a5c6-d79b8188a2db tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-volume_attachments/ba22345f-38aa-420e-b5ed-c973d0f63dcf" status: 200 len: 194 microversion: 2.1 time: 0.044155 Jun 06 21:16:12.278131 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 489/1016] 10.222.0.33 () {58 vars in 1412 bytes} [Mon Jun 6 21:16:12 2022] GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-volume_attachments/ba22345f-38aa-420e-b5ed-c973d0f63dcf => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:16:13.627263 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-202bd228-6d5d-475c-8e29-69d10c1360e1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a23bc4a8-68fd-438d-a721-98aa20a77740"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:16:13.628943 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-202bd228-6d5d-475c-8e29-69d10c1360e1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:16:13.635512 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-202bd228-6d5d-475c-8e29-69d10c1360e1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:13.636008 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-202bd228-6d5d-475c-8e29-69d10c1360e1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:13.636769 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-202bd228-6d5d-475c-8e29-69d10c1360e1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:13.637200 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-202bd228-6d5d-475c-8e29-69d10c1360e1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:13.908335 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-202bd228-6d5d-475c-8e29-69d10c1360e1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "POST /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284931 Jun 06 21:16:13.909582 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 528/1017] 10.222.0.33 () {60 vars in 1322 bytes} [Mon Jun 6 21:16:13 2022] POST /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:16:19.219560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 21:16:19.219560 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Mon Jun 6 21:16:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 21:16:21.457317 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-8edd62d4-8786-464e-afa6-0f100c43b2cb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:21.458295 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-8edd62d4-8786-464e-afa6-0f100c43b2cb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:16:21.465245 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8edd62d4-8786-464e-afa6-0f100c43b2cb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:21.465678 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8edd62d4-8786-464e-afa6-0f100c43b2cb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:21.466432 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8edd62d4-8786-464e-afa6-0f100c43b2cb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:21.466856 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-8edd62d4-8786-464e-afa6-0f100c43b2cb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:21.498132 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-8edd62d4-8786-464e-afa6-0f100c43b2cb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045830 Jun 06 21:16:21.498705 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 490/1018] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 6 21:16:21 2022] GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:16:21.667598 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-382f326c-71fe-4ba6-820d-50f849e315d6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:21.668215 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-382f326c-71fe-4ba6-820d-50f849e315d6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:16:21.670659 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=21 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:21.676258 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-382f326c-71fe-4ba6-820d-50f849e315d6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:21.676700 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-382f326c-71fe-4ba6-820d-50f849e315d6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:21.677456 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-382f326c-71fe-4ba6-820d-50f849e315d6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:21.678006 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-382f326c-71fe-4ba6-820d-50f849e315d6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:21.680927 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:21.710813 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-382f326c-71fe-4ba6-820d-50f849e315d6 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-volume_attachments/ba22345f-38aa-420e-b5ed-c973d0f63dcf" status: 200 len: 194 microversion: 2.1 time: 0.048383 Jun 06 21:16:21.711399 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 529/1019] 10.222.0.33 () {58 vars in 1412 bytes} [Mon Jun 6 21:16:21 2022] GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-volume_attachments/ba22345f-38aa-420e-b5ed-c973d0f63dcf => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:16:21.721498 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-7fc97db4-e1af-483c-a49c-18aacb9746c1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:21.721960 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-7fc97db4-e1af-483c-a49c-18aacb9746c1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:16:21.728957 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7fc97db4-e1af-483c-a49c-18aacb9746c1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:21.729397 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7fc97db4-e1af-483c-a49c-18aacb9746c1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:21.730148 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7fc97db4-e1af-483c-a49c-18aacb9746c1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:21.730569 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-7fc97db4-e1af-483c-a49c-18aacb9746c1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:21.814762 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.objects.instance [None req-7fc97db4-e1af-483c-a49c-18aacb9746c1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lazy-loading 'services' on Instance uuid 95c69a09-a44d-4656-9aff-38a2beabff4f {{(pid=117860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:16:21.908064 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-7fc97db4-e1af-483c-a49c-18aacb9746c1 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "DELETE /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-volume_attachments/ba22345f-38aa-420e-b5ed-c973d0f63dcf" status: 202 len: 0 microversion: 2.1 time: 0.190367 Jun 06 21:16:21.908660 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 491/1020] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 6 21:16:21 2022] DELETE /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-volume_attachments/ba22345f-38aa-420e-b5ed-c973d0f63dcf => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:16:23.027318 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-f5fa9ba4-5044-41fe-b69d-f90bcdcb33f8 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:23.027924 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-f5fa9ba4-5044-41fe-b69d-f90bcdcb33f8 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:16:23.034556 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f5fa9ba4-5044-41fe-b69d-f90bcdcb33f8 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:23.034942 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f5fa9ba4-5044-41fe-b69d-f90bcdcb33f8 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:23.035753 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f5fa9ba4-5044-41fe-b69d-f90bcdcb33f8 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:23.036238 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-f5fa9ba4-5044-41fe-b69d-f90bcdcb33f8 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:23.067922 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-f5fa9ba4-5044-41fe-b69d-f90bcdcb33f8 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-volume_attachments/a23bc4a8-68fd-438d-a721-98aa20a77740" status: 200 len: 194 microversion: 2.1 time: 0.045099 Jun 06 21:16:23.068645 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 530/1021] 10.222.0.33 () {58 vars in 1412 bytes} [Mon Jun 6 21:16:23 2022] GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-volume_attachments/a23bc4a8-68fd-438d-a721-98aa20a77740 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:16:23.080485 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-9d3dc6b1-1345-41f9-8356-1e8ed5c49383 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:23.081024 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-9d3dc6b1-1345-41f9-8356-1e8ed5c49383 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:16:23.088306 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9d3dc6b1-1345-41f9-8356-1e8ed5c49383 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:23.088752 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9d3dc6b1-1345-41f9-8356-1e8ed5c49383 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:23.089518 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9d3dc6b1-1345-41f9-8356-1e8ed5c49383 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:23.089970 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-9d3dc6b1-1345-41f9-8356-1e8ed5c49383 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:23.179484 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.objects.instance [None req-9d3dc6b1-1345-41f9-8356-1e8ed5c49383 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lazy-loading 'services' on Instance uuid 95c69a09-a44d-4656-9aff-38a2beabff4f {{(pid=117860) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:16:23.258689 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-9d3dc6b1-1345-41f9-8356-1e8ed5c49383 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "DELETE /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-volume_attachments/a23bc4a8-68fd-438d-a721-98aa20a77740" status: 202 len: 0 microversion: 2.1 time: 0.183106 Jun 06 21:16:23.259349 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 492/1022] 10.222.0.33 () {58 vars in 1415 bytes} [Mon Jun 6 21:16:23 2022] DELETE /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-volume_attachments/a23bc4a8-68fd-438d-a721-98aa20a77740 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:16:24.424211 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-30da818d-cf30-479e-b869-e83e4651326f tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:24.425141 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-30da818d-cf30-479e-b869-e83e4651326f tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:16:24.432493 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30da818d-cf30-479e-b869-e83e4651326f tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:24.432940 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30da818d-cf30-479e-b869-e83e4651326f tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:24.433706 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30da818d-cf30-479e-b869-e83e4651326f tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:24.434134 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-30da818d-cf30-479e-b869-e83e4651326f tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:24.465305 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-30da818d-cf30-479e-b869-e83e4651326f tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045054 Jun 06 21:16:24.465873 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 531/1023] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 6 21:16:24 2022] GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 21:16:24.580243 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-4375c8a9-daa1-468d-91cd-44f933f54b5b tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:24.581168 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-4375c8a9-daa1-468d-91cd-44f933f54b5b tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:16:24.588052 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4375c8a9-daa1-468d-91cd-44f933f54b5b tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:24.588521 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4375c8a9-daa1-468d-91cd-44f933f54b5b tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:24.589266 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4375c8a9-daa1-468d-91cd-44f933f54b5b tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:24.589687 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-4375c8a9-daa1-468d-91cd-44f933f54b5b tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:24.618610 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-4375c8a9-daa1-468d-91cd-44f933f54b5b tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043541 Jun 06 21:16:24.619188 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 493/1024] 10.222.0.33 () {58 vars in 1301 bytes} [Mon Jun 6 21:16:24 2022] GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 21:16:24.678766 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-25b39ff6-5ec9-4016-8391-a66f2f050a92 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:24.679262 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-25b39ff6-5ec9-4016-8391-a66f2f050a92 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:16:24.686120 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-25b39ff6-5ec9-4016-8391-a66f2f050a92 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:24.686569 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-25b39ff6-5ec9-4016-8391-a66f2f050a92 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:24.687321 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-25b39ff6-5ec9-4016-8391-a66f2f050a92 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:24.687753 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-25b39ff6-5ec9-4016-8391-a66f2f050a92 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:24.713901 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-25b39ff6-5ec9-4016-8391-a66f2f050a92 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 21:16:24.798400 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-25b39ff6-5ec9-4016-8391-a66f2f050a92 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "DELETE /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f" status: 204 len: 0 microversion: 2.1 time: 0.123264 Jun 06 21:16:24.799262 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 532/1025] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:16:24 2022] DELETE /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 21:16:24.807768 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-bc9fa34a-15a3-4c7f-92ee-aa419df956ae tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:24.808399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-bc9fa34a-15a3-4c7f-92ee-aa419df956ae tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:16:24.814645 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bc9fa34a-15a3-4c7f-92ee-aa419df956ae tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:24.815090 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bc9fa34a-15a3-4c7f-92ee-aa419df956ae tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:24.815856 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bc9fa34a-15a3-4c7f-92ee-aa419df956ae tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:24.816313 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-bc9fa34a-15a3-4c7f-92ee-aa419df956ae tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:24.960044 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-bc9fa34a-15a3-4c7f-92ee-aa419df956ae tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:16:24.968481 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-bc9fa34a-15a3-4c7f-92ee-aa419df956ae tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f" status: 200 len: 1673 microversion: 2.1 time: 0.165032 Jun 06 21:16:24.969059 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 494/1026] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:16:24 2022] GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f => generated 1673 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:16:25.990545 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-d7771854-e4f9-452a-8d27-ce4acea7fd28 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:25.991619 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-d7771854-e4f9-452a-8d27-ce4acea7fd28 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:16:26.002037 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d7771854-e4f9-452a-8d27-ce4acea7fd28 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:26.002707 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d7771854-e4f9-452a-8d27-ce4acea7fd28 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:26.003471 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d7771854-e4f9-452a-8d27-ce4acea7fd28 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:26.004091 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-d7771854-e4f9-452a-8d27-ce4acea7fd28 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:26.138841 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-d7771854-e4f9-452a-8d27-ce4acea7fd28 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:16:26.149350 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-d7771854-e4f9-452a-8d27-ce4acea7fd28 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f" status: 200 len: 1673 microversion: 2.1 time: 0.165653 Jun 06 21:16:26.149899 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 533/1027] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:16:25 2022] GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:16:27.168908 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-2a8a6e16-6139-4e1e-9047-21c93c80fff4 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:27.169498 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-2a8a6e16-6139-4e1e-9047-21c93c80fff4 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:16:27.176873 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2a8a6e16-6139-4e1e-9047-21c93c80fff4 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:27.177411 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2a8a6e16-6139-4e1e-9047-21c93c80fff4 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:27.178149 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2a8a6e16-6139-4e1e-9047-21c93c80fff4 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:27.178489 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-2a8a6e16-6139-4e1e-9047-21c93c80fff4 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:27.367331 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-2a8a6e16-6139-4e1e-9047-21c93c80fff4 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ecf39d671ac4f52be5dd80a5ec55615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce7fbb51b32d4342a7b06db4199b5638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:16:27.377923 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-2a8a6e16-6139-4e1e-9047-21c93c80fff4 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f" status: 200 len: 1673 microversion: 2.1 time: 0.214304 Jun 06 21:16:27.378805 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 495/1028] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:16:27 2022] GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f => generated 1673 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:16:27.778770 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [req-1e84cd6c-67b6-4fc2-a6f0-0fb706e21fdc req-4b268292-11af-4da4-9781-f993629bfdbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c69a09-a44d-4656-9aff-38a2beabff4f", "name": "network-vif-deleted", "tag": "7eef49e8-52f0-4c02-a5f1-955c7165e6bd"}]} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:16:27.788215 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-1e84cd6c-67b6-4fc2-a6f0-0fb706e21fdc req-4b268292-11af-4da4-9781-f993629bfdbe service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:27.793764 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [req-1e84cd6c-67b6-4fc2-a6f0-0fb706e21fdc req-4b268292-11af-4da4-9781-f993629bfdbe service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:27.813100 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.compute.server_external_events [req-1e84cd6c-67b6-4fc2-a6f0-0fb706e21fdc req-4b268292-11af-4da4-9781-f993629bfdbe service nova] Creating event network-vif-deleted:7eef49e8-52f0-4c02-a5f1-955c7165e6bd for instance 95c69a09-a44d-4656-9aff-38a2beabff4f on hv-cinder-84488 Jun 06 21:16:27.819513 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [req-1e84cd6c-67b6-4fc2-a6f0-0fb706e21fdc req-4b268292-11af-4da4-9781-f993629bfdbe service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043598 Jun 06 21:16:27.821355 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 534/1029] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:16:28.396029 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-36f4ea9f-7df3-4b61-b76b-90a8cc579d63 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:28.396671 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-36f4ea9f-7df3-4b61-b76b-90a8cc579d63 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:16:28.403557 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-36f4ea9f-7df3-4b61-b76b-90a8cc579d63 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:28.404018 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-36f4ea9f-7df3-4b61-b76b-90a8cc579d63 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:28.404797 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-36f4ea9f-7df3-4b61-b76b-90a8cc579d63 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:28.405228 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-36f4ea9f-7df3-4b61-b76b-90a8cc579d63 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:28.419209 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-36f4ea9f-7df3-4b61-b76b-90a8cc579d63 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] HTTP exception thrown: Instance 95c69a09-a44d-4656-9aff-38a2beabff4f could not be found. Jun 06 21:16:28.420920 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-36f4ea9f-7df3-4b61-b76b-90a8cc579d63 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Request method failure captured: Jun 06 21:16:28.420920 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f HTTP/1.1 Jun 06 21:16:28.420920 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:16:28.420920 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:16:28.420920 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:16:28.420920 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 0 Jun 06 21:16:28.420920 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:16:28.420920 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:16:28.420920 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:16:28.420920 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:16:28.420920 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinm2cOSEcezPPrBFaIH2SDs1Uc5aZF68gyqD8c8M5iTw8oHPVDA8Jh3_HvjLQ_ptyQRZLl0DWMuZz62Z_NDjpbGhHxdHcvzbuuknSsp8HS8vkFQE5s9Z7NrzTXKMAQb4vZEIk3XGBPjk_s5W3wPOZMskC9kwvlOMLCppWlZI3xg6T2-o Jun 06 21:16:28.420920 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:16:28.420920 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:16:28.420920 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:16:28.420920 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:16:28.420920 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:16:28.420920 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:16:28.420920 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: ce7fbb51b32d4342a7b06db4199b5638 Jun 06 21:16:28.420920 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-AttachVolumeTestJSON-459007962 Jun 06 21:16:28.420920 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:16:28.420920 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:16:28.422403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:16:28.422403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-AttachVolumeTestJSON-459007962 Jun 06 21:16:28.422403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: ce7fbb51b32d4342a7b06db4199b5638 Jun 06 21:16:28.422403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-AttachVolumeTestJSON-459007962 Jun 06 21:16:28.422403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-AttachVolumeTestJSON-459007962-project Jun 06 21:16:28.422403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:16:28.422403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:16:28.422403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: 0ecf39d671ac4f52be5dd80a5ec55615 Jun 06 21:16:28.422403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-AttachVolumeTestJSON-459007962-project Jun 06 21:16:28.422403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: > Jun 06 21:16:28.422403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Instance 95c69a09-a44d-4656-9aff-38a2beabff4f could not be found. Jun 06 21:16:28.422403 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'id': '95c69a09-a44d-4656-9aff-38a2beabff4f'} Jun 06 21:16:28.423216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:16:28.423216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:28.423216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:16:28.423216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:16:28.423216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:16:28.423216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:16:28.423216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:16:28.423216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:16:28.423216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:16:28.423216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:16:28.423216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c69a09-a44d-4656-9aff-38a2beabff4f could not be found. Jun 06 21:16:28.423216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:28.423216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:16:28.423216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:28.423216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:28.423216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:16:28.423216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:16:28.423216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:16:28.423216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:16:28.423216 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:16:28.424615 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:16:28.424615 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:16:28.424615 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:16:28.424615 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:16:28.424615 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:16:28.424615 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:16:28.424615 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:16:28.424615 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c69a09-a44d-4656-9aff-38a2beabff4f could not be found. Jun 06 21:16:28.424615 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:28.424615 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:16:28.424615 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:28.424615 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:28.424615 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:16:28.424615 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:16:28.424615 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:16:28.424615 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:16:28.424615 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c69a09-a44d-4656-9aff-38a2beabff4f could not be found. Jun 06 21:16:28.424615 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:28.425851 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-36f4ea9f-7df3-4b61-b76b-90a8cc579d63 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Returning 404 to user: Instance 95c69a09-a44d-4656-9aff-38a2beabff4f could not be found. {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:16:28.425851 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-36f4ea9f-7df3-4b61-b76b-90a8cc579d63 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f" status: 404 len: 111 microversion: 2.1 time: 0.030940 Jun 06 21:16:28.425851 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 496/1030] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:16:28 2022] GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:16:28.432933 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e87498e4-a4e0-43ca-997d-fa25d391d2bb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '.version_select at 0x7f27256a8ca0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:28.452954 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e87498e4-a4e0-43ca-997d-fa25d391d2bb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-468921441" status: 202 len: 0 microversion: 2.1 time: 0.024170 Jun 06 21:16:28.453538 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 535/1031] 10.222.0.33 () {58 vars in 1217 bytes} [Mon Jun 6 21:16:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-468921441 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:16:31.400455 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-34d7e97e-f600-4a78-b4c4-2a7659b0e39e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:31.401600 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-34d7e97e-f600-4a78-b4c4-2a7659b0e39e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:16:31.408052 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-34d7e97e-f600-4a78-b4c4-2a7659b0e39e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:31.408479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-34d7e97e-f600-4a78-b4c4-2a7659b0e39e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:31.409264 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-34d7e97e-f600-4a78-b4c4-2a7659b0e39e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:31.409686 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-34d7e97e-f600-4a78-b4c4-2a7659b0e39e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:31.423741 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-34d7e97e-f600-4a78-b4c4-2a7659b0e39e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] HTTP exception thrown: Instance 95c69a09-a44d-4656-9aff-38a2beabff4f could not be found. Jun 06 21:16:31.425320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-34d7e97e-f600-4a78-b4c4-2a7659b0e39e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Request method failure captured: Jun 06 21:16:31.425320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: DELETE /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f HTTP/1.1 Jun 06 21:16:31.425320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:16:31.425320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:16:31.425320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:16:31.425320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 0 Jun 06 21:16:31.425320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:16:31.425320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:16:31.425320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:16:31.425320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:16:31.425320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinm2cOSEcezPPrBFaIH2SDs1Uc5aZF68gyqD8c8M5iTw8oHPVDA8Jh3_HvjLQ_ptyQRZLl0DWMuZz62Z_NDjpbGhHxdHcvzbuuknSsp8HS8vkFQE5s9Z7NrzTXKMAQb4vZEIk3XGBPjk_s5W3wPOZMskC9kwvlOMLCppWlZI3xg6T2-o Jun 06 21:16:31.425320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:16:31.425320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:16:31.425320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:16:31.425320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:16:31.425320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:16:31.425320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:16:31.425320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: ce7fbb51b32d4342a7b06db4199b5638 Jun 06 21:16:31.425320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-AttachVolumeTestJSON-459007962 Jun 06 21:16:31.425320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:16:31.425320 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:16:31.426907 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:16:31.426907 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-AttachVolumeTestJSON-459007962 Jun 06 21:16:31.426907 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: ce7fbb51b32d4342a7b06db4199b5638 Jun 06 21:16:31.426907 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-AttachVolumeTestJSON-459007962 Jun 06 21:16:31.426907 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-AttachVolumeTestJSON-459007962-project Jun 06 21:16:31.426907 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:16:31.426907 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:16:31.426907 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: 0ecf39d671ac4f52be5dd80a5ec55615 Jun 06 21:16:31.426907 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-AttachVolumeTestJSON-459007962-project Jun 06 21:16:31.426907 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: > Jun 06 21:16:31.426907 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Instance 95c69a09-a44d-4656-9aff-38a2beabff4f could not be found. Jun 06 21:16:31.426907 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'id': '95c69a09-a44d-4656-9aff-38a2beabff4f'} Jun 06 21:16:31.427745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:16:31.427745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:31.427745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:16:31.427745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:16:31.427745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:16:31.427745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:16:31.427745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:16:31.427745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:16:31.427745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:16:31.427745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:16:31.427745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c69a09-a44d-4656-9aff-38a2beabff4f could not be found. Jun 06 21:16:31.427745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:31.427745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:16:31.427745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:31.427745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:31.427745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:16:31.427745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:16:31.427745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:16:31.427745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:16:31.427745 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:16:31.429121 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:16:31.429121 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 21:16:31.429121 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 21:16:31.429121 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 21:16:31.429121 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 21:16:31.429121 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:16:31.429121 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:16:31.429121 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:16:31.429121 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:16:31.429121 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c69a09-a44d-4656-9aff-38a2beabff4f could not be found. Jun 06 21:16:31.429121 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:31.429121 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:16:31.429121 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:31.429121 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:31.429121 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:16:31.429121 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:16:31.429121 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:16:31.429121 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:16:31.429121 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c69a09-a44d-4656-9aff-38a2beabff4f could not be found. Jun 06 21:16:31.429121 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:31.430735 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-34d7e97e-f600-4a78-b4c4-2a7659b0e39e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Returning 404 to user: Instance 95c69a09-a44d-4656-9aff-38a2beabff4f could not be found. {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:16:31.430735 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-34d7e97e-f600-4a78-b4c4-2a7659b0e39e tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "DELETE /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f" status: 404 len: 111 microversion: 2.1 time: 0.030107 Jun 06 21:16:31.430735 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 497/1032] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:16:31 2022] DELETE /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:16:31.436037 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-83bb806d-f75c-4a1b-886c-4f0d6b56ae94 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:31.436799 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-83bb806d-f75c-4a1b-886c-4f0d6b56ae94 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: 95c69a09-a44d-4656-9aff-38a2beabff4f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:16:31.443490 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-83bb806d-f75c-4a1b-886c-4f0d6b56ae94 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:31.443938 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-83bb806d-f75c-4a1b-886c-4f0d6b56ae94 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:31.444758 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-83bb806d-f75c-4a1b-886c-4f0d6b56ae94 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:31.445195 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-83bb806d-f75c-4a1b-886c-4f0d6b56ae94 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:31.460401 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-83bb806d-f75c-4a1b-886c-4f0d6b56ae94 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] HTTP exception thrown: Instance 95c69a09-a44d-4656-9aff-38a2beabff4f could not be found. Jun 06 21:16:31.462075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-83bb806d-f75c-4a1b-886c-4f0d6b56ae94 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Request method failure captured: Jun 06 21:16:31.462075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f HTTP/1.1 Jun 06 21:16:31.462075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:16:31.462075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:16:31.462075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:16:31.462075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:16:31.462075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:16:31.462075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:16:31.462075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:16:31.462075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:16:31.462075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinm2cOSEcezPPrBFaIH2SDs1Uc5aZF68gyqD8c8M5iTw8oHPVDA8Jh3_HvjLQ_ptyQRZLl0DWMuZz62Z_NDjpbGhHxdHcvzbuuknSsp8HS8vkFQE5s9Z7NrzTXKMAQb4vZEIk3XGBPjk_s5W3wPOZMskC9kwvlOMLCppWlZI3xg6T2-o Jun 06 21:16:31.462075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:16:31.462075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:16:31.462075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:16:31.462075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:16:31.462075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:16:31.462075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:16:31.462075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: ce7fbb51b32d4342a7b06db4199b5638 Jun 06 21:16:31.462075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeTestJSON-459007962 Jun 06 21:16:31.462075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:16:31.462075 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:16:31.464383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:16:31.464383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeTestJSON-459007962 Jun 06 21:16:31.464383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: ce7fbb51b32d4342a7b06db4199b5638 Jun 06 21:16:31.464383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeTestJSON-459007962 Jun 06 21:16:31.464383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeTestJSON-459007962-project Jun 06 21:16:31.464383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:16:31.464383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:16:31.464383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: 0ecf39d671ac4f52be5dd80a5ec55615 Jun 06 21:16:31.464383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeTestJSON-459007962-project Jun 06 21:16:31.464383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: > Jun 06 21:16:31.464383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Instance 95c69a09-a44d-4656-9aff-38a2beabff4f could not be found. Jun 06 21:16:31.464383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': '95c69a09-a44d-4656-9aff-38a2beabff4f'} Jun 06 21:16:31.465154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:16:31.465154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:31.465154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:16:31.465154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:16:31.465154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:16:31.465154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:16:31.465154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:16:31.465154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:16:31.465154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:16:31.465154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:16:31.465154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c69a09-a44d-4656-9aff-38a2beabff4f could not be found. Jun 06 21:16:31.465154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:31.465154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:16:31.465154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:31.465154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:31.465154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:16:31.465154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:16:31.465154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:16:31.465154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:16:31.465154 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:16:31.466416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:16:31.466416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:16:31.466416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:16:31.466416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:16:31.466416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:16:31.466416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:16:31.466416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:16:31.466416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c69a09-a44d-4656-9aff-38a2beabff4f could not be found. Jun 06 21:16:31.466416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:31.466416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:16:31.466416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:31.466416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:31.466416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:16:31.466416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:16:31.466416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:16:31.466416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:16:31.466416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c69a09-a44d-4656-9aff-38a2beabff4f could not be found. Jun 06 21:16:31.466416 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:31.467629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-83bb806d-f75c-4a1b-886c-4f0d6b56ae94 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Returning 404 to user: Instance 95c69a09-a44d-4656-9aff-38a2beabff4f could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:16:31.467629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-83bb806d-f75c-4a1b-886c-4f0d6b56ae94 tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f" status: 404 len: 111 microversion: 2.1 time: 0.032152 Jun 06 21:16:31.467629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 536/1033] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:16:31 2022] GET /compute/v2.1/servers/95c69a09-a44d-4656-9aff-38a2beabff4f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:16:32.628997 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-74c84ed9-d0b5-445f-9ced-6ad0a2c9e33d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:32.629561 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-74c84ed9-d0b5-445f-9ced-6ad0a2c9e33d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:16:32.639019 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-74c84ed9-d0b5-445f-9ced-6ad0a2c9e33d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:32.639583 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-74c84ed9-d0b5-445f-9ced-6ad0a2c9e33d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:32.640742 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-74c84ed9-d0b5-445f-9ced-6ad0a2c9e33d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:32.641277 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-74c84ed9-d0b5-445f-9ced-6ad0a2c9e33d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:32.661084 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-74c84ed9-d0b5-445f-9ced-6ad0a2c9e33d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] HTTP exception thrown: Instance ce90b0bc-be67-4862-bac1-77835f2d7a0f could not be found. Jun 06 21:16:32.663236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-74c84ed9-d0b5-445f-9ced-6ad0a2c9e33d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Request method failure captured: Jun 06 21:16:32.663236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: DELETE /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f HTTP/1.1 Jun 06 21:16:32.663236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:16:32.663236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:16:32.663236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:16:32.663236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 0 Jun 06 21:16:32.663236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:16:32.663236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:16:32.663236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:16:32.663236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:16:32.663236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinm2cOSEcezPPrBFaIH2SDs1Uc5aZF68gyqD8c8M5iTw8oHPVDA8Jh3_HvjLQ_ptyQRZLl0DWMuZz62Z_NDjpbGhHxdHcvzbuuknSsp8HS8vkFQE5s9Z7NrzTXKMAQb4vZEIk3XGBPjk_s5W3wPOZMskC9kwvlOMLCppWlZI3xg6T2-o Jun 06 21:16:32.663236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:16:32.663236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:16:32.663236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:16:32.663236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:16:32.663236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:16:32.663236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:16:32.663236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: ce7fbb51b32d4342a7b06db4199b5638 Jun 06 21:16:32.663236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-AttachVolumeTestJSON-459007962 Jun 06 21:16:32.663236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:16:32.663236 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:16:32.664900 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:16:32.664900 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-AttachVolumeTestJSON-459007962 Jun 06 21:16:32.664900 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: ce7fbb51b32d4342a7b06db4199b5638 Jun 06 21:16:32.664900 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-AttachVolumeTestJSON-459007962 Jun 06 21:16:32.664900 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-AttachVolumeTestJSON-459007962-project Jun 06 21:16:32.664900 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:16:32.664900 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:16:32.664900 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: 0ecf39d671ac4f52be5dd80a5ec55615 Jun 06 21:16:32.664900 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-AttachVolumeTestJSON-459007962-project Jun 06 21:16:32.664900 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: > Jun 06 21:16:32.664900 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Instance ce90b0bc-be67-4862-bac1-77835f2d7a0f could not be found. Jun 06 21:16:32.664900 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'id': 'ce90b0bc-be67-4862-bac1-77835f2d7a0f'} Jun 06 21:16:32.665667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:16:32.665667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:32.665667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:16:32.665667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:16:32.665667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:16:32.665667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:16:32.665667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:16:32.665667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:16:32.665667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:16:32.665667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:16:32.665667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce90b0bc-be67-4862-bac1-77835f2d7a0f could not be found. Jun 06 21:16:32.665667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:32.665667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:16:32.665667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:32.665667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:32.665667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:16:32.665667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:16:32.665667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:16:32.665667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:16:32.665667 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:16:32.666922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:16:32.666922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 21:16:32.666922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 21:16:32.666922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 21:16:32.666922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 21:16:32.666922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:16:32.666922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:16:32.666922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:16:32.666922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:16:32.666922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce90b0bc-be67-4862-bac1-77835f2d7a0f could not be found. Jun 06 21:16:32.666922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:32.666922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:16:32.666922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:32.666922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:32.666922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:16:32.666922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:16:32.666922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:16:32.666922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:16:32.666922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce90b0bc-be67-4862-bac1-77835f2d7a0f could not be found. Jun 06 21:16:32.666922 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:32.668633 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-74c84ed9-d0b5-445f-9ced-6ad0a2c9e33d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Returning 404 to user: Instance ce90b0bc-be67-4862-bac1-77835f2d7a0f could not be found. {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:16:32.668633 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-74c84ed9-d0b5-445f-9ced-6ad0a2c9e33d tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "DELETE /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 404 len: 111 microversion: 2.1 time: 0.042155 Jun 06 21:16:32.668633 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 498/1034] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:16:32 2022] DELETE /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:16:32.673759 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ac4d4d46-2102-4fa4-9f68-b096d69019cb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:32.674403 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-ac4d4d46-2102-4fa4-9f68-b096d69019cb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] [instance: ce90b0bc-be67-4862-bac1-77835f2d7a0f] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:16:32.681339 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac4d4d46-2102-4fa4-9f68-b096d69019cb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:32.681810 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac4d4d46-2102-4fa4-9f68-b096d69019cb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:32.682561 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac4d4d46-2102-4fa4-9f68-b096d69019cb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:16:32.682990 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-ac4d4d46-2102-4fa4-9f68-b096d69019cb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:16:32.697037 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-ac4d4d46-2102-4fa4-9f68-b096d69019cb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] HTTP exception thrown: Instance ce90b0bc-be67-4862-bac1-77835f2d7a0f could not be found. Jun 06 21:16:32.698584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ac4d4d46-2102-4fa4-9f68-b096d69019cb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Request method failure captured: Jun 06 21:16:32.698584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f HTTP/1.1 Jun 06 21:16:32.698584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:16:32.698584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:16:32.698584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:16:32.698584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:16:32.698584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:16:32.698584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:16:32.698584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:16:32.698584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:16:32.698584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinm2cOSEcezPPrBFaIH2SDs1Uc5aZF68gyqD8c8M5iTw8oHPVDA8Jh3_HvjLQ_ptyQRZLl0DWMuZz62Z_NDjpbGhHxdHcvzbuuknSsp8HS8vkFQE5s9Z7NrzTXKMAQb4vZEIk3XGBPjk_s5W3wPOZMskC9kwvlOMLCppWlZI3xg6T2-o Jun 06 21:16:32.698584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:16:32.698584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:16:32.698584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:16:32.698584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:16:32.698584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:16:32.698584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:16:32.698584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: ce7fbb51b32d4342a7b06db4199b5638 Jun 06 21:16:32.698584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-AttachVolumeTestJSON-459007962 Jun 06 21:16:32.698584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:16:32.698584 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:16:32.700477 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/ce7fbb51b32d4342a7b06db4199b5638"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:16:32.700477 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-AttachVolumeTestJSON-459007962 Jun 06 21:16:32.700477 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: ce7fbb51b32d4342a7b06db4199b5638 Jun 06 21:16:32.700477 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-AttachVolumeTestJSON-459007962 Jun 06 21:16:32.700477 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-AttachVolumeTestJSON-459007962-project Jun 06 21:16:32.700477 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:16:32.700477 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:16:32.700477 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: 0ecf39d671ac4f52be5dd80a5ec55615 Jun 06 21:16:32.700477 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-AttachVolumeTestJSON-459007962-project Jun 06 21:16:32.700477 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: > Jun 06 21:16:32.700477 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Instance ce90b0bc-be67-4862-bac1-77835f2d7a0f could not be found. Jun 06 21:16:32.700477 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': 'ce90b0bc-be67-4862-bac1-77835f2d7a0f'} Jun 06 21:16:32.701519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:16:32.701519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:32.701519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:16:32.701519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:16:32.701519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:16:32.701519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:16:32.701519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:16:32.701519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:16:32.701519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:16:32.701519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:16:32.701519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce90b0bc-be67-4862-bac1-77835f2d7a0f could not be found. Jun 06 21:16:32.701519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:32.701519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:16:32.701519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:32.701519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:32.701519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:16:32.701519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:16:32.701519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:16:32.701519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:16:32.701519 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:16:32.703383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:16:32.703383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:16:32.703383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:16:32.703383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:16:32.703383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:16:32.703383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:16:32.703383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:16:32.703383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce90b0bc-be67-4862-bac1-77835f2d7a0f could not be found. Jun 06 21:16:32.703383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:32.703383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:16:32.703383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:32.703383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:32.703383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:16:32.703383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:16:32.703383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:16:32.703383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:16:32.703383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce90b0bc-be67-4862-bac1-77835f2d7a0f could not be found. Jun 06 21:16:32.703383 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:32.704893 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ac4d4d46-2102-4fa4-9f68-b096d69019cb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] Returning 404 to user: Instance ce90b0bc-be67-4862-bac1-77835f2d7a0f could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:16:32.704893 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ac4d4d46-2102-4fa4-9f68-b096d69019cb tempest-AttachVolumeTestJSON-459007962 tempest-AttachVolumeTestJSON-459007962-project] 10.222.0.33 "GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f" status: 404 len: 111 microversion: 2.1 time: 0.030115 Jun 06 21:16:32.704893 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 537/1035] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:16:32 2022] GET /compute/v2.1/servers/ce90b0bc-be67-4862-bac1-77835f2d7a0f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:16:37.396389 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-eb55f488-e453-493d-a8b8-ebbf6de9a761 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Action: 'create', calling method: .version_select at 0x7f2725fbe9d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1409690377"}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:16:37.715328 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-eb55f488-e453-493d-a8b8-ebbf6de9a761 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] 10.222.0.33 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.465833 Jun 06 21:16:37.716034 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 499/1036] 10.222.0.33 () {60 vars in 1154 bytes} [Mon Jun 6 21:16:37 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 467 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 06 21:16:37.727366 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-7face6fe-d27a-48e9-9aba-5d42ac43b781 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Calling method '.version_select at 0x7f272583cc10>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:37.778240 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-7face6fe-d27a-48e9-9aba-5d42ac43b781 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d755f0a0-4051-4dc2-a292-fb6681272557" status: 200 len: 345 microversion: 2.1 time: 0.054703 Jun 06 21:16:37.778807 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 538/1037] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 6 21:16:37 2022] GET /compute/v2.1/os-volumes/d755f0a0-4051-4dc2-a292-fb6681272557 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:16:38.792048 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-b8663cc0-8573-42a7-83a5-02fde211d86f tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Calling method '.version_select at 0x7f272607f820>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:38.844420 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-b8663cc0-8573-42a7-83a5-02fde211d86f tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d755f0a0-4051-4dc2-a292-fb6681272557" status: 200 len: 346 microversion: 2.1 time: 0.057233 Jun 06 21:16:38.845027 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 500/1038] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 6 21:16:38 2022] GET /compute/v2.1/os-volumes/d755f0a0-4051-4dc2-a292-fb6681272557 => generated 346 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:16:38.856966 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ab8e71ce-e07e-424f-8515-0a2f78729106 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Action: 'create', calling method: .version_select at 0x7f27257e4a60>, body: {"snapshot": {"volume_id": "d755f0a0-4051-4dc2-a292-fb6681272557", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-241267484"}} {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:16:39.025879 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ab8e71ce-e07e-424f-8515-0a2f78729106 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] 10.222.0.33 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.173363 Jun 06 21:16:39.026542 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 539/1039] 10.222.0.33 () {60 vars in 1161 bytes} [Mon Jun 6 21:16:38 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:16:39.039466 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-cb6067e4-842d-4c12-8288-8cc2a6116e67 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Calling method '.version_select at 0x7f27262e2940>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:39.073995 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-cb6067e4-842d-4c12-8288-8cc2a6116e67 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/047e29d9-5a3a-4c98-acf5-f484139e2f69" status: 200 len: 286 microversion: 2.1 time: 0.040817 Jun 06 21:16:39.074979 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 501/1040] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jun 6 21:16:39 2022] GET /compute/v2.1/os-snapshots/047e29d9-5a3a-4c98-acf5-f484139e2f69 => generated 286 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:16:39.085827 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-5226cd13-6de0-4f1a-b931-1e0812894a2a tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Calling method '.version_select at 0x7f272565df70>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:39.115352 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-5226cd13-6de0-4f1a-b931-1e0812894a2a tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.033565 Jun 06 21:16:39.115920 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 540/1041] 10.222.0.33 () {58 vars in 1139 bytes} [Mon Jun 6 21:16:39 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:16:39.126497 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-df277a84-25f1-408c-9321-a3230f6972fa tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Calling method '.version_select at 0x7f27260ec5e0>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:39.159663 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-df277a84-25f1-408c-9321-a3230f6972fa tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/047e29d9-5a3a-4c98-acf5-f484139e2f69" status: 200 len: 286 microversion: 2.1 time: 0.037083 Jun 06 21:16:39.160289 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 502/1042] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jun 6 21:16:39 2022] GET /compute/v2.1/os-snapshots/047e29d9-5a3a-4c98-acf5-f484139e2f69 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:16:40.174267 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ec1560d5-ca8b-4ce4-8c1a-9544e62afa64 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Calling method '.version_select at 0x7f2725866940>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:40.207660 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ec1560d5-ca8b-4ce4-8c1a-9544e62afa64 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/047e29d9-5a3a-4c98-acf5-f484139e2f69" status: 200 len: 286 microversion: 2.1 time: 0.038341 Jun 06 21:16:40.208300 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 541/1043] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jun 6 21:16:40 2022] GET /compute/v2.1/os-snapshots/047e29d9-5a3a-4c98-acf5-f484139e2f69 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:16:41.220837 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-d82bff60-c787-4baa-a4a2-db57fc25a9db tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Calling method '.version_select at 0x7f2725fbe790>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:41.252770 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-d82bff60-c787-4baa-a4a2-db57fc25a9db tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/047e29d9-5a3a-4c98-acf5-f484139e2f69" status: 200 len: 286 microversion: 2.1 time: 0.036346 Jun 06 21:16:41.253352 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 503/1044] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jun 6 21:16:41 2022] GET /compute/v2.1/os-snapshots/047e29d9-5a3a-4c98-acf5-f484139e2f69 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:16:42.265730 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-905af49f-b205-4e28-9c19-09c67e58b907 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Calling method '.version_select at 0x7f27258c03a0>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:42.302976 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-905af49f-b205-4e28-9c19-09c67e58b907 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/047e29d9-5a3a-4c98-acf5-f484139e2f69" status: 200 len: 287 microversion: 2.1 time: 0.042115 Jun 06 21:16:42.303500 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 542/1045] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jun 6 21:16:42 2022] GET /compute/v2.1/os-snapshots/047e29d9-5a3a-4c98-acf5-f484139e2f69 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:16:42.314712 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0f1ef823-ca90-422d-b49b-8a9dbf1efcb1 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Calling method '.version_select at 0x7f272607f820>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:42.385490 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-0f1ef823-ca90-422d-b49b-8a9dbf1efcb1 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] 10.222.0.33 "DELETE /compute/v2.1/os-snapshots/047e29d9-5a3a-4c98-acf5-f484139e2f69" status: 202 len: 0 microversion: 2.1 time: 0.074749 Jun 06 21:16:42.386376 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 504/1046] 10.222.0.33 () {58 vars in 1253 bytes} [Mon Jun 6 21:16:42 2022] DELETE /compute/v2.1/os-snapshots/047e29d9-5a3a-4c98-acf5-f484139e2f69 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:16:42.394844 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-ac7bc926-87b8-4557-b604-2fabd2954509 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Calling method '.version_select at 0x7f2725866700>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:42.425240 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-ac7bc926-87b8-4557-b604-2fabd2954509 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/047e29d9-5a3a-4c98-acf5-f484139e2f69" status: 200 len: 286 microversion: 2.1 time: 0.034370 Jun 06 21:16:42.425807 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 543/1047] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jun 6 21:16:42 2022] GET /compute/v2.1/os-snapshots/047e29d9-5a3a-4c98-acf5-f484139e2f69 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:16:43.434658 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_api:SELECT=22 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:43.435526 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:43.440827 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-471189dc-88b7-4a34-a282-f8698645a11d tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Calling method '.version_select at 0x7f2725f86a60>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:43.467128 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-471189dc-88b7-4a34-a282-f8698645a11d tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] HTTP exception thrown: Snapshot 047e29d9-5a3a-4c98-acf5-f484139e2f69 could not be found. Jun 06 21:16:43.470218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-471189dc-88b7-4a34-a282-f8698645a11d tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Request method failure captured: Jun 06 21:16:43.470218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: GET /compute/v2.1/os-snapshots/047e29d9-5a3a-4c98-acf5-f484139e2f69 HTTP/1.1 Jun 06 21:16:43.470218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:16:43.470218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:16:43.470218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:16:43.470218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 0 Jun 06 21:16:43.470218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:16:43.470218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:16:43.470218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:16:43.470218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:16:43.470218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinm61c-_aa-mQVA1ASG2o-JiTdj-f6RYpJU8pUpmHlSVQwh5F3t4j717IKlNc6rmcY3QWnyUBLL47MjatrwoFe3N_Pz-WUBhXhv4fNASlj3IFiHQ7HSpVzm7c1ypLKWNSGsF_UZKqJUSuN9gA0nWJla7jcdJLLNSZCAdmOEp_iEDCDNU Jun 06 21:16:43.470218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:16:43.470218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:16:43.470218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:16:43.470218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:16:43.470218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:16:43.470218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:16:43.470218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: a85eea5f8c154566aae74eefecdbba2f Jun 06 21:16:43.470218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1170712602 Jun 06 21:16:43.470218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:16:43.470218 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:16:43.471847 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a85eea5f8c154566aae74eefecdbba2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a85eea5f8c154566aae74eefecdbba2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a85eea5f8c154566aae74eefecdbba2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a85eea5f8c154566aae74eefecdbba2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:16:43.471847 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1170712602 Jun 06 21:16:43.471847 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: a85eea5f8c154566aae74eefecdbba2f Jun 06 21:16:43.471847 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1170712602 Jun 06 21:16:43.471847 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-VolumesSnapshotsTestJSON-1170712602-project Jun 06 21:16:43.471847 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:16:43.471847 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:16:43.471847 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: 38423a68ff8e4d139ea09526e88d99f1 Jun 06 21:16:43.471847 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1170712602-project Jun 06 21:16:43.471847 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: Jun 06 21:16:43.471847 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Snapshot 047e29d9-5a3a-4c98-acf5-f484139e2f69 could not be found. Jun 06 21:16:43.471847 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'id': '047e29d9-5a3a-4c98-acf5-f484139e2f69'} Jun 06 21:16:43.471847 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:16:43.472896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:43.472896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 06 21:16:43.472896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 06 21:16:43.472896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 06 21:16:43.472896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 06 21:16:43.472896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 06 21:16:43.472896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 06 21:16:43.472896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 21:16:43.472896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 21:16:43.472896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 21:16:43.472896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 21:16:43.472896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 21:16:43.472896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 21:16:43.472896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 21:16:43.472896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 21:16:43.472896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 047e29d9-5a3a-4c98-acf5-f484139e2f69 could not be found. (HTTP 404) (Request-ID: req-41e6cf59-4b48-44f8-81bf-b503eff803fd) Jun 06 21:16:43.472896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:43.472896 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:16:43.474144 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:43.474144 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:43.474144 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 06 21:16:43.474144 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 06 21:16:43.474144 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 21:16:43.474144 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 21:16:43.474144 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 06 21:16:43.474144 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 06 21:16:43.474144 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 21:16:43.474144 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 21:16:43.474144 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 06 21:16:43.474144 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 06 21:16:43.474144 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 06 21:16:43.474144 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 06 21:16:43.474144 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 06 21:16:43.474144 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 06 21:16:43.474144 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 21:16:43.474144 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 21:16:43.474144 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 21:16:43.475399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 21:16:43.475399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 21:16:43.475399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 21:16:43.475399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 21:16:43.475399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 21:16:43.475399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 047e29d9-5a3a-4c98-acf5-f484139e2f69 could not be found. Jun 06 21:16:43.475399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:43.475399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:16:43.475399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:43.475399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:43.475399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:16:43.475399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:16:43.475399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:16:43.475399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:16:43.475399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 21:16:43.475399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 21:16:43.475399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:16:43.475399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:16:43.475399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 06 21:16:43.475399 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:16:43.476943 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 047e29d9-5a3a-4c98-acf5-f484139e2f69 could not be found. Jun 06 21:16:43.476943 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:43.476943 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:16:43.476943 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:43.476943 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:43.476943 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:16:43.476943 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:16:43.476943 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:16:43.476943 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:16:43.476943 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 047e29d9-5a3a-4c98-acf5-f484139e2f69 could not be found. Jun 06 21:16:43.476943 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:43.476943 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-471189dc-88b7-4a34-a282-f8698645a11d tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Returning 404 to user: Snapshot 047e29d9-5a3a-4c98-acf5-f484139e2f69 could not be found. {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:16:43.476943 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-471189dc-88b7-4a34-a282-f8698645a11d tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] 10.222.0.33 "GET /compute/v2.1/os-snapshots/047e29d9-5a3a-4c98-acf5-f484139e2f69" status: 404 len: 111 microversion: 2.1 time: 0.038065 Jun 06 21:16:43.478017 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 505/1048] 10.222.0.33 () {58 vars in 1250 bytes} [Mon Jun 6 21:16:43 2022] GET /compute/v2.1/os-snapshots/047e29d9-5a3a-4c98-acf5-f484139e2f69 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:16:43.480369 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-00d86c05-0aef-4a2b-88ac-4c15c4df51b4 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Calling method '.version_select at 0x7f2725932160>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:43.486639 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:43.487397 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:16:43.547071 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-00d86c05-0aef-4a2b-88ac-4c15c4df51b4 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/d755f0a0-4051-4dc2-a292-fb6681272557" status: 202 len: 0 microversion: 2.1 time: 0.070353 Jun 06 21:16:43.547656 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 544/1049] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jun 6 21:16:43 2022] DELETE /compute/v2.1/os-volumes/d755f0a0-4051-4dc2-a292-fb6681272557 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 21:16:43.556121 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-a075ed2f-8483-416c-be7f-12ff8f8a22fb tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Calling method '.version_select at 0x7f272607ff70>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:43.604034 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-a075ed2f-8483-416c-be7f-12ff8f8a22fb tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d755f0a0-4051-4dc2-a292-fb6681272557" status: 200 len: 345 microversion: 2.1 time: 0.051566 Jun 06 21:16:43.604660 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 506/1050] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 6 21:16:43 2022] GET /compute/v2.1/os-volumes/d755f0a0-4051-4dc2-a292-fb6681272557 => generated 345 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:16:44.617246 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6e56c4dd-2e11-4324-b196-a10bd0061655 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Calling method '.version_select at 0x7f27258c0d30>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:44.652278 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-6e56c4dd-2e11-4324-b196-a10bd0061655 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] HTTP exception thrown: Volume d755f0a0-4051-4dc2-a292-fb6681272557 could not be found. Jun 06 21:16:44.654276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6e56c4dd-2e11-4324-b196-a10bd0061655 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Request method failure captured: Jun 06 21:16:44.654276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/os-volumes/d755f0a0-4051-4dc2-a292-fb6681272557 HTTP/1.1 Jun 06 21:16:44.654276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:16:44.654276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:16:44.654276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:16:44.654276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:16:44.654276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:16:44.654276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:16:44.654276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:16:44.654276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:16:44.654276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinm61c-_aa-mQVA1ASG2o-JiTdj-f6RYpJU8pUpmHlSVQwh5F3t4j717IKlNc6rmcY3QWnyUBLL47MjatrwoFe3N_Pz-WUBhXhv4fNASlj3IFiHQ7HSpVzm7c1ypLKWNSGsF_UZKqJUSuN9gA0nWJla7jcdJLLNSZCAdmOEp_iEDCDNU Jun 06 21:16:44.654276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:16:44.654276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:16:44.654276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:16:44.654276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:16:44.654276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:16:44.654276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:16:44.654276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: a85eea5f8c154566aae74eefecdbba2f Jun 06 21:16:44.654276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1170712602 Jun 06 21:16:44.654276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:16:44.654276 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:16:44.655932 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a85eea5f8c154566aae74eefecdbba2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a85eea5f8c154566aae74eefecdbba2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a85eea5f8c154566aae74eefecdbba2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a85eea5f8c154566aae74eefecdbba2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:16:44.655932 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1170712602 Jun 06 21:16:44.655932 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: a85eea5f8c154566aae74eefecdbba2f Jun 06 21:16:44.655932 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1170712602 Jun 06 21:16:44.655932 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesSnapshotsTestJSON-1170712602-project Jun 06 21:16:44.655932 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:16:44.655932 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:16:44.655932 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: 38423a68ff8e4d139ea09526e88d99f1 Jun 06 21:16:44.655932 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1170712602-project Jun 06 21:16:44.655932 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: Jun 06 21:16:44.655932 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Volume d755f0a0-4051-4dc2-a292-fb6681272557 could not be found. Jun 06 21:16:44.655932 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': 'd755f0a0-4051-4dc2-a292-fb6681272557'} Jun 06 21:16:44.655932 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:16:44.657629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:44.657629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 21:16:44.657629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 21:16:44.657629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 21:16:44.657629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 21:16:44.657629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 21:16:44.657629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 21:16:44.657629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 21:16:44.657629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 21:16:44.657629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 21:16:44.657629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 21:16:44.657629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 21:16:44.657629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 21:16:44.657629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 21:16:44.657629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 21:16:44.657629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d755f0a0-4051-4dc2-a292-fb6681272557 could not be found. (HTTP 404) (Request-ID: req-6533c291-55c6-4e8c-95a5-4bd3c0c9fc04) Jun 06 21:16:44.657629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:44.657629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:16:44.657629 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:44.659015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:44.659015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 21:16:44.659015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 21:16:44.659015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 21:16:44.659015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 21:16:44.659015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 21:16:44.659015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 21:16:44.659015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 21:16:44.659015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 21:16:44.659015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 21:16:44.659015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 21:16:44.659015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 21:16:44.659015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 21:16:44.659015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 21:16:44.659015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 21:16:44.659015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 21:16:44.659015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 21:16:44.659015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 21:16:44.659015 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 21:16:44.660510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 21:16:44.660510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 21:16:44.660510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 21:16:44.660510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 21:16:44.660510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d755f0a0-4051-4dc2-a292-fb6681272557 could not be found. Jun 06 21:16:44.660510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:44.660510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:16:44.660510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:44.660510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:44.660510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:16:44.660510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:16:44.660510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:16:44.660510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:16:44.660510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 21:16:44.660510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 21:16:44.660510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:16:44.660510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:16:44.660510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 21:16:44.660510 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:16:44.661998 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d755f0a0-4051-4dc2-a292-fb6681272557 could not be found. Jun 06 21:16:44.661998 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:44.661998 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:16:44.661998 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:44.661998 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:44.661998 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:16:44.661998 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:16:44.661998 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:16:44.661998 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:16:44.661998 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d755f0a0-4051-4dc2-a292-fb6681272557 could not be found. Jun 06 21:16:44.661998 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:44.661998 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-6e56c4dd-2e11-4324-b196-a10bd0061655 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Returning 404 to user: Volume d755f0a0-4051-4dc2-a292-fb6681272557 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:16:44.661998 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-6e56c4dd-2e11-4324-b196-a10bd0061655 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d755f0a0-4051-4dc2-a292-fb6681272557" status: 404 len: 109 microversion: 2.1 time: 0.043775 Jun 06 21:16:44.661998 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 545/1051] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 6 21:16:44 2022] GET /compute/v2.1/os-volumes/d755f0a0-4051-4dc2-a292-fb6681272557 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:16:44.674168 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-afed9f8d-f1ec-49fd-8425-8bc95d524721 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Calling method '.version_select at 0x7f27260ec310>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:44.702018 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-afed9f8d-f1ec-49fd-8425-8bc95d524721 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] HTTP exception thrown: Volume d755f0a0-4051-4dc2-a292-fb6681272557 could not be found. Jun 06 21:16:44.705324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-afed9f8d-f1ec-49fd-8425-8bc95d524721 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Request method failure captured: Jun 06 21:16:44.705324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: DELETE /compute/v2.1/os-volumes/d755f0a0-4051-4dc2-a292-fb6681272557 HTTP/1.1 Jun 06 21:16:44.705324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:16:44.705324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:16:44.705324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:16:44.705324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 0 Jun 06 21:16:44.705324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:16:44.705324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:16:44.705324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:16:44.705324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:16:44.705324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinm61c-_aa-mQVA1ASG2o-JiTdj-f6RYpJU8pUpmHlSVQwh5F3t4j717IKlNc6rmcY3QWnyUBLL47MjatrwoFe3N_Pz-WUBhXhv4fNASlj3IFiHQ7HSpVzm7c1ypLKWNSGsF_UZKqJUSuN9gA0nWJla7jcdJLLNSZCAdmOEp_iEDCDNU Jun 06 21:16:44.705324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:16:44.705324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:16:44.705324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:16:44.705324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:16:44.705324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:16:44.705324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:16:44.705324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: a85eea5f8c154566aae74eefecdbba2f Jun 06 21:16:44.705324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1170712602 Jun 06 21:16:44.705324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:16:44.705324 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:16:44.707040 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a85eea5f8c154566aae74eefecdbba2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a85eea5f8c154566aae74eefecdbba2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a85eea5f8c154566aae74eefecdbba2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a85eea5f8c154566aae74eefecdbba2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:16:44.707040 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1170712602 Jun 06 21:16:44.707040 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: a85eea5f8c154566aae74eefecdbba2f Jun 06 21:16:44.707040 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1170712602 Jun 06 21:16:44.707040 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-VolumesSnapshotsTestJSON-1170712602-project Jun 06 21:16:44.707040 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:16:44.707040 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:16:44.707040 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: 38423a68ff8e4d139ea09526e88d99f1 Jun 06 21:16:44.707040 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1170712602-project Jun 06 21:16:44.707040 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: Jun 06 21:16:44.707040 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Volume d755f0a0-4051-4dc2-a292-fb6681272557 could not be found. Jun 06 21:16:44.707040 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'id': 'd755f0a0-4051-4dc2-a292-fb6681272557'} Jun 06 21:16:44.707040 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:16:44.707965 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:44.707965 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 21:16:44.707965 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 21:16:44.707965 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 21:16:44.707965 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 21:16:44.707965 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 21:16:44.707965 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 21:16:44.707965 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 21:16:44.707965 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 21:16:44.707965 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 21:16:44.707965 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 21:16:44.707965 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 21:16:44.707965 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 21:16:44.707965 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 21:16:44.707965 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 21:16:44.707965 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d755f0a0-4051-4dc2-a292-fb6681272557 could not be found. (HTTP 404) (Request-ID: req-233e0f44-a21f-40db-9bf3-d34ef51cc162) Jun 06 21:16:44.707965 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:44.707965 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:16:44.707965 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:44.709307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:44.709307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 06 21:16:44.709307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 06 21:16:44.709307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 21:16:44.709307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 21:16:44.709307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 21:16:44.709307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 21:16:44.709307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 21:16:44.709307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 21:16:44.709307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 21:16:44.709307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 21:16:44.709307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 21:16:44.709307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 21:16:44.709307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 21:16:44.709307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 21:16:44.709307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 21:16:44.709307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 21:16:44.709307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 21:16:44.709307 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 21:16:44.710531 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 21:16:44.710531 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 21:16:44.710531 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 21:16:44.710531 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 21:16:44.710531 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d755f0a0-4051-4dc2-a292-fb6681272557 could not be found. Jun 06 21:16:44.710531 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:44.710531 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:16:44.710531 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:44.710531 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:44.710531 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:16:44.710531 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:16:44.710531 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:16:44.710531 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:16:44.710531 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 21:16:44.710531 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 21:16:44.710531 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:16:44.710531 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:16:44.710531 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 06 21:16:44.710531 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:16:44.712042 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d755f0a0-4051-4dc2-a292-fb6681272557 could not be found. Jun 06 21:16:44.712042 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:44.712042 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:16:44.712042 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:44.712042 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:44.712042 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:16:44.712042 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:16:44.712042 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:16:44.712042 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:16:44.712042 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d755f0a0-4051-4dc2-a292-fb6681272557 could not be found. Jun 06 21:16:44.712042 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:16:44.712042 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-afed9f8d-f1ec-49fd-8425-8bc95d524721 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Returning 404 to user: Volume d755f0a0-4051-4dc2-a292-fb6681272557 could not be found. {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:16:44.712042 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-afed9f8d-f1ec-49fd-8425-8bc95d524721 tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] 10.222.0.33 "DELETE /compute/v2.1/os-volumes/d755f0a0-4051-4dc2-a292-fb6681272557" status: 404 len: 109 microversion: 2.1 time: 0.039439 Jun 06 21:16:44.713064 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 507/1052] 10.222.0.33 () {58 vars in 1247 bytes} [Mon Jun 6 21:16:44 2022] DELETE /compute/v2.1/os-volumes/d755f0a0-4051-4dc2-a292-fb6681272557 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:16:44.715198 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-09952bc1-9160-4193-a4bf-1b44418e171f tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Calling method '.version_select at 0x7f2725932430>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:16:44.743125 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.wsgi [None req-09952bc1-9160-4193-a4bf-1b44418e171f tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] HTTP exception thrown: Volume d755f0a0-4051-4dc2-a292-fb6681272557 could not be found. Jun 06 21:16:44.745109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-09952bc1-9160-4193-a4bf-1b44418e171f tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Request method failure captured: Jun 06 21:16:44.745109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: request: GET /compute/v2.1/os-volumes/d755f0a0-4051-4dc2-a292-fb6681272557 HTTP/1.1 Jun 06 21:16:44.745109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept: application/json Jun 06 21:16:44.745109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Accept-Encoding: identity Jun 06 21:16:44.745109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Connection: close Jun 06 21:16:44.745109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Length: 0 Jun 06 21:16:44.745109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Content-Type: application/json Jun 06 21:16:44.745109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Host: 10.222.0.33 Jun 06 21:16:44.745109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Openstack-System-Scope: None Jun 06 21:16:44.745109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: User-Agent: python-urllib3/1.26.9 Jun 06 21:16:44.745109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Auth-Token: gAAAAABinm61c-_aa-mQVA1ASG2o-JiTdj-f6RYpJU8pUpmHlSVQwh5F3t4j717IKlNc6rmcY3QWnyUBLL47MjatrwoFe3N_Pz-WUBhXhv4fNASlj3IFiHQ7HSpVzm7c1ypLKWNSGsF_UZKqJUSuN9gA0nWJla7jcdJLLNSZCAdmOEp_iEDCDNU Jun 06 21:16:44.745109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Id: None Jun 06 21:16:44.745109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Domain-Name: None Jun 06 21:16:44.745109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Identity-Status: Confirmed Jun 06 21:16:44.745109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Is-Admin-Project: True Jun 06 21:16:44.745109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Id: default Jun 06 21:16:44.745109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Domain-Name: Default Jun 06 21:16:44.745109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Id: a85eea5f8c154566aae74eefecdbba2f Jun 06 21:16:44.745109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1170712602 Jun 06 21:16:44.745109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Role: reader,member Jun 06 21:16:44.745109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Roles: reader,member Jun 06 21:16:44.746746 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a85eea5f8c154566aae74eefecdbba2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_a85eea5f8c154566aae74eefecdbba2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/a85eea5f8c154566aae74eefecdbba2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/a85eea5f8c154566aae74eefecdbba2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:16:44.746746 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1170712602 Jun 06 21:16:44.746746 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Id: a85eea5f8c154566aae74eefecdbba2f Jun 06 21:16:44.746746 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1170712602 Jun 06 21:16:44.746746 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User: tempest-VolumesSnapshotsTestJSON-1170712602-project Jun 06 21:16:44.746746 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Id: default Jun 06 21:16:44.746746 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Domain-Name: Default Jun 06 21:16:44.746746 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Id: 38423a68ff8e4d139ea09526e88d99f1 Jun 06 21:16:44.746746 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1170712602-project Jun 06 21:16:44.746746 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: method: Jun 06 21:16:44.746746 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: exception: Volume d755f0a0-4051-4dc2-a292-fb6681272557 could not be found. Jun 06 21:16:44.746746 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: action_args: {'id': 'd755f0a0-4051-4dc2-a292-fb6681272557'} Jun 06 21:16:44.746746 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:16:44.747895 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:44.747895 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 21:16:44.747895 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 21:16:44.747895 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 21:16:44.747895 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 21:16:44.747895 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 21:16:44.747895 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 21:16:44.747895 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 21:16:44.747895 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 21:16:44.747895 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 21:16:44.747895 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 21:16:44.747895 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 21:16:44.747895 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 21:16:44.747895 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 21:16:44.747895 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 21:16:44.747895 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d755f0a0-4051-4dc2-a292-fb6681272557 could not be found. (HTTP 404) (Request-ID: req-65dea163-0c32-4b12-b6c7-5132268e37a6) Jun 06 21:16:44.747895 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:44.747895 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:16:44.747895 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:44.749372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:44.749372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 21:16:44.749372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 21:16:44.749372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 21:16:44.749372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 21:16:44.749372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 21:16:44.749372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 21:16:44.749372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 21:16:44.749372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 21:16:44.749372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 21:16:44.749372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 21:16:44.749372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 21:16:44.749372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 21:16:44.749372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 21:16:44.749372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 21:16:44.749372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 21:16:44.749372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 21:16:44.749372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 21:16:44.749372 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 21:16:44.751032 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 21:16:44.751032 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 21:16:44.751032 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 21:16:44.751032 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 21:16:44.751032 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d755f0a0-4051-4dc2-a292-fb6681272557 could not be found. Jun 06 21:16:44.751032 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:44.751032 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:16:44.751032 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:44.751032 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:44.751032 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:16:44.751032 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:16:44.751032 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:16:44.751032 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:16:44.751032 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 21:16:44.751032 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 21:16:44.751032 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:16:44.751032 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:16:44.751032 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 21:16:44.751032 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:16:44.752647 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d755f0a0-4051-4dc2-a292-fb6681272557 could not be found. Jun 06 21:16:44.752647 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:44.752647 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:16:44.752647 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:44.752647 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:16:44.752647 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:16:44.752647 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:16:44.752647 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:16:44.752647 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:16:44.752647 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d755f0a0-4051-4dc2-a292-fb6681272557 could not be found. Jun 06 21:16:44.752647 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: ERROR nova.api.openstack.wsgi Jun 06 21:16:44.752647 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-09952bc1-9160-4193-a4bf-1b44418e171f tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] Returning 404 to user: Volume d755f0a0-4051-4dc2-a292-fb6681272557 could not be found. {{(pid=117859) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:16:44.752647 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-09952bc1-9160-4193-a4bf-1b44418e171f tempest-VolumesSnapshotsTestJSON-1170712602 tempest-VolumesSnapshotsTestJSON-1170712602-project] 10.222.0.33 "GET /compute/v2.1/os-volumes/d755f0a0-4051-4dc2-a292-fb6681272557" status: 404 len: 109 microversion: 2.1 time: 0.035052 Jun 06 21:16:44.752647 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 546/1053] 10.222.0.33 () {58 vars in 1244 bytes} [Mon Jun 6 21:16:44 2022] GET /compute/v2.1/os-volumes/d755f0a0-4051-4dc2-a292-fb6681272557 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:17:15.907981 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-65df08b0-a95f-44fb-9a8f-14d2357accb3 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1226537312", "imageRef": "e4266a01-7d22-4036-91e8-3ec50e3369c1", "flavorRef": "452"}} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:17:15.965963 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.network.neutron [None req-65df08b0-a95f-44fb-9a8f-14d2357accb3 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] validate_networks() for None {{(pid=117860) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 21:17:16.251727 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-65df08b0-a95f-44fb-9a8f-14d2357accb3 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Flavor limits 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 21:17:16.252223 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-65df08b0-a95f-44fb-9a8f-14d2357accb3 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Image limits 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 21:17:16.252679 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-65df08b0-a95f-44fb-9a8f-14d2357accb3 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Flavor pref 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 21:17:16.253081 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-65df08b0-a95f-44fb-9a8f-14d2357accb3 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Image pref 0:0:0 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 21:17:16.253492 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.virt.hardware [None req-65df08b0-a95f-44fb-9a8f-14d2357accb3 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117860) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 21:17:16.262992 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-65df08b0-a95f-44fb-9a8f-14d2357accb3 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:16.263440 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-65df08b0-a95f-44fb-9a8f-14d2357accb3 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:16.264275 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-65df08b0-a95f-44fb-9a8f-14d2357accb3 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:16.264713 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-65df08b0-a95f-44fb-9a8f-14d2357accb3 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:16.282204 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-65df08b0-a95f-44fb-9a8f-14d2357accb3 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Getting quotas for project f691f36fd59b408a8efb3b0a7f79d46f. Resources: {'ram', 'cores', 'instances'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 21:17:16.286584 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.quota [None req-65df08b0-a95f-44fb-9a8f-14d2357accb3 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Getting quotas for user 3e81b3131fbb4c248c30ab105d857a9a and project f691f36fd59b408a8efb3b0a7f79d46f. Resources: {'ram', 'cores', 'instances'} {{(pid=117860) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 21:17:16.299215 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-65df08b0-a95f-44fb-9a8f-14d2357accb3 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Going to run 1 instances... {{(pid=117860) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 21:17:16.301557 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-65df08b0-a95f-44fb-9a8f-14d2357accb3 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] [instance: 740370c6-f791-4204-a281-71d40f3ce49d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e4266a01-7d22-4036-91e8-3ec50e3369c1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117860) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 21:17:16.362978 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-65df08b0-a95f-44fb-9a8f-14d2357accb3 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] 10.222.0.33 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.461776 Jun 06 21:17:16.363637 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 508/1054] 10.222.0.33 () {60 vars in 1146 bytes} [Mon Jun 6 21:17:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 21:17:16.378544 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-be545f8b-8ed5-48e7-be4f-40bc9930c34f tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:17:16.379441 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-be545f8b-8ed5-48e7-be4f-40bc9930c34f tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] [instance: 740370c6-f791-4204-a281-71d40f3ce49d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:17:16.434204 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-be545f8b-8ed5-48e7-be4f-40bc9930c34f tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e81b3131fbb4c248c30ab105d857a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f691f36fd59b408a8efb3b0a7f79d46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:17:16.440805 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-be545f8b-8ed5-48e7-be4f-40bc9930c34f tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] 10.222.0.33 "GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d" status: 200 len: 1215 microversion: 2.1 time: 0.070763 Jun 06 21:17:16.441373 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 547/1055] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:17:16 2022] GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:17:17.459225 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-e99317c0-0708-4026-9dd8-b602dcaae758 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:17:17.460701 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-e99317c0-0708-4026-9dd8-b602dcaae758 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] [instance: 740370c6-f791-4204-a281-71d40f3ce49d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:17:17.467523 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e99317c0-0708-4026-9dd8-b602dcaae758 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:17.467974 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e99317c0-0708-4026-9dd8-b602dcaae758 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:17.468763 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e99317c0-0708-4026-9dd8-b602dcaae758 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:17.469189 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-e99317c0-0708-4026-9dd8-b602dcaae758 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:17.536849 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-e99317c0-0708-4026-9dd8-b602dcaae758 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e81b3131fbb4c248c30ab105d857a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f691f36fd59b408a8efb3b0a7f79d46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:17:17.544898 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-e99317c0-0708-4026-9dd8-b602dcaae758 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] 10.222.0.33 "GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d" status: 200 len: 1275 microversion: 2.1 time: 0.089927 Jun 06 21:17:17.545621 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 509/1056] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:17:17 2022] GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d => generated 1275 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:17:18.563009 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-dbb78840-a920-4c65-b1f0-a86687cb3386 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:17:18.563627 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-dbb78840-a920-4c65-b1f0-a86687cb3386 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] [instance: 740370c6-f791-4204-a281-71d40f3ce49d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:17:18.570506 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dbb78840-a920-4c65-b1f0-a86687cb3386 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:18.570943 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dbb78840-a920-4c65-b1f0-a86687cb3386 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:18.571691 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dbb78840-a920-4c65-b1f0-a86687cb3386 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:18.572151 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-dbb78840-a920-4c65-b1f0-a86687cb3386 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:18.712805 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-dbb78840-a920-4c65-b1f0-a86687cb3386 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e81b3131fbb4c248c30ab105d857a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f691f36fd59b408a8efb3b0a7f79d46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:17:18.720331 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-dbb78840-a920-4c65-b1f0-a86687cb3386 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] 10.222.0.33 "GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d" status: 200 len: 1315 microversion: 2.1 time: 0.161276 Jun 06 21:17:18.720905 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 548/1057] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:17:18 2022] GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:17:18.975406 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-5c01a238-db62-49ea-8c06-efca58117952 req-7dcdcf7e-0c00-4a3c-bad5-576892331f0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "740370c6-f791-4204-a281-71d40f3ce49d", "tag": "71d2c397-2d75-4e09-b4b5-9e2b37df08f7"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:17:18.987854 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-5c01a238-db62-49ea-8c06-efca58117952 req-7dcdcf7e-0c00-4a3c-bad5-576892331f0e service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:18.988545 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-5c01a238-db62-49ea-8c06-efca58117952 req-7dcdcf7e-0c00-4a3c-bad5-576892331f0e service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:19.001278 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-5c01a238-db62-49ea-8c06-efca58117952 req-7dcdcf7e-0c00-4a3c-bad5-576892331f0e service nova] Creating event network-changed:71d2c397-2d75-4e09-b4b5-9e2b37df08f7 for instance 740370c6-f791-4204-a281-71d40f3ce49d on hv-cinder-84488 Jun 06 21:17:19.011257 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-5c01a238-db62-49ea-8c06-efca58117952 req-7dcdcf7e-0c00-4a3c-bad5-576892331f0e service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039587 Jun 06 21:17:19.011908 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 510/1058] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:17:19.739356 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-0e045f1e-d96e-45e3-8307-8b577ef103c1 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:17:19.740063 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-0e045f1e-d96e-45e3-8307-8b577ef103c1 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] [instance: 740370c6-f791-4204-a281-71d40f3ce49d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:17:19.748646 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0e045f1e-d96e-45e3-8307-8b577ef103c1 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:19.749204 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0e045f1e-d96e-45e3-8307-8b577ef103c1 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:19.750246 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0e045f1e-d96e-45e3-8307-8b577ef103c1 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:19.750850 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-0e045f1e-d96e-45e3-8307-8b577ef103c1 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:19.917055 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-0e045f1e-d96e-45e3-8307-8b577ef103c1 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e81b3131fbb4c248c30ab105d857a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f691f36fd59b408a8efb3b0a7f79d46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:17:19.925059 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-0e045f1e-d96e-45e3-8307-8b577ef103c1 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] 10.222.0.33 "GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d" status: 200 len: 1315 microversion: 2.1 time: 0.190789 Jun 06 21:17:19.925658 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 549/1059] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:17:19 2022] GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:17:20.943159 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-0860a957-fcb3-47cb-8be1-403702ecdf1c tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:17:20.943775 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-0860a957-fcb3-47cb-8be1-403702ecdf1c tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] [instance: 740370c6-f791-4204-a281-71d40f3ce49d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:17:20.951063 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0860a957-fcb3-47cb-8be1-403702ecdf1c tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:20.951535 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0860a957-fcb3-47cb-8be1-403702ecdf1c tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:20.952687 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0860a957-fcb3-47cb-8be1-403702ecdf1c tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:20.953118 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-0860a957-fcb3-47cb-8be1-403702ecdf1c tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:21.182740 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-0860a957-fcb3-47cb-8be1-403702ecdf1c tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e81b3131fbb4c248c30ab105d857a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f691f36fd59b408a8efb3b0a7f79d46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:17:21.190937 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-0860a957-fcb3-47cb-8be1-403702ecdf1c tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] 10.222.0.33 "GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d" status: 200 len: 1315 microversion: 2.1 time: 0.252643 Jun 06 21:17:21.191518 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 511/1060] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:17:20 2022] GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:17:22.209452 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-e70b8e4b-9edb-49f4-8180-8dc19496e669 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:17:22.210142 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-e70b8e4b-9edb-49f4-8180-8dc19496e669 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] [instance: 740370c6-f791-4204-a281-71d40f3ce49d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:17:22.217346 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e70b8e4b-9edb-49f4-8180-8dc19496e669 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:22.217788 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e70b8e4b-9edb-49f4-8180-8dc19496e669 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:22.218540 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e70b8e4b-9edb-49f4-8180-8dc19496e669 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:22.218966 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-e70b8e4b-9edb-49f4-8180-8dc19496e669 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:22.360349 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-e70b8e4b-9edb-49f4-8180-8dc19496e669 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e81b3131fbb4c248c30ab105d857a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f691f36fd59b408a8efb3b0a7f79d46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:17:22.370405 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-e70b8e4b-9edb-49f4-8180-8dc19496e669 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] 10.222.0.33 "GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d" status: 200 len: 1315 microversion: 2.1 time: 0.164809 Jun 06 21:17:22.371483 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 550/1061] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:17:22 2022] GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:17:23.387830 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-98bb8e3d-e9de-46d3-a84e-e1685e40172e tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:17:23.388494 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-98bb8e3d-e9de-46d3-a84e-e1685e40172e tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] [instance: 740370c6-f791-4204-a281-71d40f3ce49d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:17:23.397276 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-98bb8e3d-e9de-46d3-a84e-e1685e40172e tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:23.397868 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-98bb8e3d-e9de-46d3-a84e-e1685e40172e tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:23.399305 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-98bb8e3d-e9de-46d3-a84e-e1685e40172e tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:23.399863 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-98bb8e3d-e9de-46d3-a84e-e1685e40172e tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:23.538433 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-98bb8e3d-e9de-46d3-a84e-e1685e40172e tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e81b3131fbb4c248c30ab105d857a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f691f36fd59b408a8efb3b0a7f79d46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:17:23.546673 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-98bb8e3d-e9de-46d3-a84e-e1685e40172e tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] 10.222.0.33 "GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d" status: 200 len: 1315 microversion: 2.1 time: 0.162738 Jun 06 21:17:23.547256 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 512/1062] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:17:23 2022] GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:17:24.562973 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-925dc2a4-d62e-400d-9157-4d0e82699eec tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:17:24.563546 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-925dc2a4-d62e-400d-9157-4d0e82699eec tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] [instance: 740370c6-f791-4204-a281-71d40f3ce49d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:17:24.570523 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-925dc2a4-d62e-400d-9157-4d0e82699eec tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:24.570967 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-925dc2a4-d62e-400d-9157-4d0e82699eec tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:24.571723 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-925dc2a4-d62e-400d-9157-4d0e82699eec tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:24.572192 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-925dc2a4-d62e-400d-9157-4d0e82699eec tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:24.718944 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-925dc2a4-d62e-400d-9157-4d0e82699eec tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e81b3131fbb4c248c30ab105d857a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f691f36fd59b408a8efb3b0a7f79d46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:17:24.728621 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-925dc2a4-d62e-400d-9157-4d0e82699eec tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] 10.222.0.33 "GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d" status: 200 len: 1315 microversion: 2.1 time: 0.169318 Jun 06 21:17:24.729395 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 551/1063] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:17:24 2022] GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:17:24.975160 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-b0b8cb28-7874-449f-8d0c-5cb4c5628f33 req-f1c1ebc2-373f-4532-98fa-d32f126102d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "740370c6-f791-4204-a281-71d40f3ce49d", "name": "network-vif-plugged", "status": "completed", "tag": "71d2c397-2d75-4e09-b4b5-9e2b37df08f7"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:17:24.983507 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-b0b8cb28-7874-449f-8d0c-5cb4c5628f33 req-f1c1ebc2-373f-4532-98fa-d32f126102d0 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:24.983933 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-b0b8cb28-7874-449f-8d0c-5cb4c5628f33 req-f1c1ebc2-373f-4532-98fa-d32f126102d0 service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:24.995886 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-b0b8cb28-7874-449f-8d0c-5cb4c5628f33 req-f1c1ebc2-373f-4532-98fa-d32f126102d0 service nova] Creating event network-vif-plugged:71d2c397-2d75-4e09-b4b5-9e2b37df08f7 for instance 740370c6-f791-4204-a281-71d40f3ce49d on hv-cinder-84488 Jun 06 21:17:25.001265 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-b0b8cb28-7874-449f-8d0c-5cb4c5628f33 req-f1c1ebc2-373f-4532-98fa-d32f126102d0 service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157558 Jun 06 21:17:25.001859 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 513/1064] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:17:25.750203 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-075e6d20-3756-40ff-a47f-dd6be2719c9e tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:17:25.750798 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-075e6d20-3756-40ff-a47f-dd6be2719c9e tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] [instance: 740370c6-f791-4204-a281-71d40f3ce49d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:17:25.761044 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-075e6d20-3756-40ff-a47f-dd6be2719c9e tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:25.761603 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-075e6d20-3756-40ff-a47f-dd6be2719c9e tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:25.762630 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-075e6d20-3756-40ff-a47f-dd6be2719c9e tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:25.763361 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-075e6d20-3756-40ff-a47f-dd6be2719c9e tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:25.904396 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-075e6d20-3756-40ff-a47f-dd6be2719c9e tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e81b3131fbb4c248c30ab105d857a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f691f36fd59b408a8efb3b0a7f79d46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:17:25.912406 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-075e6d20-3756-40ff-a47f-dd6be2719c9e tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] 10.222.0.33 "GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d" status: 200 len: 1315 microversion: 2.1 time: 0.168269 Jun 06 21:17:25.912970 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 552/1065] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:17:25 2022] GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:17:26.932575 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=2 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:17:26.933477 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG dbcounter [-] [117860] Writing DB stats nova_cell0:SELECT=6 {{(pid=117860) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:17:26.937846 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-f52bda2b-722a-45f9-971f-bfb36ff2a7b2 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:17:26.938547 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-f52bda2b-722a-45f9-971f-bfb36ff2a7b2 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] [instance: 740370c6-f791-4204-a281-71d40f3ce49d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:17:26.945916 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f52bda2b-722a-45f9-971f-bfb36ff2a7b2 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:26.946366 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f52bda2b-722a-45f9-971f-bfb36ff2a7b2 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:26.947132 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f52bda2b-722a-45f9-971f-bfb36ff2a7b2 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:26.947563 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-f52bda2b-722a-45f9-971f-bfb36ff2a7b2 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:27.089842 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-f52bda2b-722a-45f9-971f-bfb36ff2a7b2 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e81b3131fbb4c248c30ab105d857a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f691f36fd59b408a8efb3b0a7f79d46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:17:27.097612 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-f52bda2b-722a-45f9-971f-bfb36ff2a7b2 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] 10.222.0.33 "GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d" status: 200 len: 1465 microversion: 2.1 time: 0.166490 Jun 06 21:17:27.098197 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 514/1066] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:17:26 2022] GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d => generated 1465 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:17:27.140304 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-99648775-bcad-4a80-b2e4-308c10f531de tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:17:27.140819 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-99648775-bcad-4a80-b2e4-308c10f531de tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] [instance: 740370c6-f791-4204-a281-71d40f3ce49d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:17:27.142744 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG dbcounter [-] [117859] Writing DB stats nova_cell0:SELECT=2 {{(pid=117859) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 21:17:27.149143 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-99648775-bcad-4a80-b2e4-308c10f531de tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:27.149583 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-99648775-bcad-4a80-b2e4-308c10f531de tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:27.150341 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-99648775-bcad-4a80-b2e4-308c10f531de tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:27.150791 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-99648775-bcad-4a80-b2e4-308c10f531de tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:27.179332 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-99648775-bcad-4a80-b2e4-308c10f531de tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] [instance: 740370c6-f791-4204-a281-71d40f3ce49d] Going to try to terminate instance {{(pid=117859) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 21:17:27.264853 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-99648775-bcad-4a80-b2e4-308c10f531de tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] 10.222.0.33 "DELETE /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d" status: 204 len: 0 microversion: 2.1 time: 0.127947 Jun 06 21:17:27.265527 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 553/1067] 10.222.0.33 () {58 vars in 1238 bytes} [Mon Jun 6 21:17:27 2022] DELETE /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 21:17:27.274728 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-48e3fde8-2be3-4fd8-a084-a8f96e7f99ff tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:17:27.275464 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-48e3fde8-2be3-4fd8-a084-a8f96e7f99ff tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] [instance: 740370c6-f791-4204-a281-71d40f3ce49d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:17:27.281867 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-48e3fde8-2be3-4fd8-a084-a8f96e7f99ff tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:27.282282 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-48e3fde8-2be3-4fd8-a084-a8f96e7f99ff tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:27.283032 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-48e3fde8-2be3-4fd8-a084-a8f96e7f99ff tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:27.283458 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-48e3fde8-2be3-4fd8-a084-a8f96e7f99ff tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:27.423962 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.policy [None req-48e3fde8-2be3-4fd8-a084-a8f96e7f99ff tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e81b3131fbb4c248c30ab105d857a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f691f36fd59b408a8efb3b0a7f79d46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117860) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:17:27.432272 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-48e3fde8-2be3-4fd8-a084-a8f96e7f99ff tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] 10.222.0.33 "GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d" status: 200 len: 1471 microversion: 2.1 time: 0.162043 Jun 06 21:17:27.432843 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 515/1068] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:17:27 2022] GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:17:28.454049 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-fc26544c-95b8-4274-93ce-9a8fe89fa32a tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:17:28.454938 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-fc26544c-95b8-4274-93ce-9a8fe89fa32a tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] [instance: 740370c6-f791-4204-a281-71d40f3ce49d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:17:28.463971 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc26544c-95b8-4274-93ce-9a8fe89fa32a tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:28.464602 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc26544c-95b8-4274-93ce-9a8fe89fa32a tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:28.465407 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc26544c-95b8-4274-93ce-9a8fe89fa32a tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:28.465832 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-fc26544c-95b8-4274-93ce-9a8fe89fa32a tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:28.606949 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-fc26544c-95b8-4274-93ce-9a8fe89fa32a tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e81b3131fbb4c248c30ab105d857a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f691f36fd59b408a8efb3b0a7f79d46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:17:28.617978 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-fc26544c-95b8-4274-93ce-9a8fe89fa32a tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] 10.222.0.33 "GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d" status: 200 len: 1471 microversion: 2.1 time: 0.171145 Jun 06 21:17:28.618781 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 554/1069] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:17:28 2022] GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d => generated 1471 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:17:29.206052 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [req-1049e0f0-1a41-417f-82a7-55aad614f77d req-78b94c90-6425-4f21-bd16-5ebf0422876d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "740370c6-f791-4204-a281-71d40f3ce49d", "name": "network-vif-deleted", "tag": "71d2c397-2d75-4e09-b4b5-9e2b37df08f7"}]} {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 21:17:29.224613 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-1049e0f0-1a41-417f-82a7-55aad614f77d req-78b94c90-6425-4f21-bd16-5ebf0422876d service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:29.225376 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [req-1049e0f0-1a41-417f-82a7-55aad614f77d req-78b94c90-6425-4f21-bd16-5ebf0422876d service nova] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:29.239353 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.compute.server_external_events [req-1049e0f0-1a41-417f-82a7-55aad614f77d req-78b94c90-6425-4f21-bd16-5ebf0422876d service nova] Creating event network-vif-deleted:71d2c397-2d75-4e09-b4b5-9e2b37df08f7 for instance 740370c6-f791-4204-a281-71d40f3ce49d on hv-cinder-84488 Jun 06 21:17:29.244971 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [req-1049e0f0-1a41-417f-82a7-55aad614f77d req-78b94c90-6425-4f21-bd16-5ebf0422876d service nova] 10.222.0.33 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042950 Jun 06 21:17:29.245591 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 516/1070] 10.222.0.33 () {64 vars in 1317 bytes} [Mon Jun 6 21:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 21:17:29.641581 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.api.openstack.wsgi [None req-a0653c06-43a4-46b0-8902-07f77818effe tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Calling method '>' {{(pid=117859) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:17:29.642138 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.compute.api [None req-a0653c06-43a4-46b0-8902-07f77818effe tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] [instance: 740370c6-f791-4204-a281-71d40f3ce49d] Fetching instance by UUID {{(pid=117859) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:17:29.649109 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a0653c06-43a4-46b0-8902-07f77818effe tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:29.649624 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a0653c06-43a4-46b0-8902-07f77818effe tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:29.650409 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a0653c06-43a4-46b0-8902-07f77818effe tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:29.650824 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a0653c06-43a4-46b0-8902-07f77818effe tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:29.686411 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a0653c06-43a4-46b0-8902-07f77818effe tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:29.686939 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG oslo_concurrency.lockutils [None req-a0653c06-43a4-46b0-8902-07f77818effe tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117859) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:29.687386 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.objects.instance [None req-a0653c06-43a4-46b0-8902-07f77818effe tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lazy-loading 'fault' on Instance uuid 740370c6-f791-4204-a281-71d40f3ce49d {{(pid=117859) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 21:17:29.733507 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: DEBUG nova.policy [None req-a0653c06-43a4-46b0-8902-07f77818effe tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3e81b3131fbb4c248c30ab105d857a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f691f36fd59b408a8efb3b0a7f79d46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117859) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 21:17:29.742300 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO nova.api.openstack.requestlog [None req-a0653c06-43a4-46b0-8902-07f77818effe tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] 10.222.0.33 "GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d" status: 200 len: 1305 microversion: 2.1 time: 0.104724 Jun 06 21:17:29.743400 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: [pid: 117859|app: 0|req: 555/1071] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:17:29 2022] GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d => generated 1305 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 21:17:30.761564 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-64e1c475-778c-41e1-988a-73e47855e0c5 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Calling method '>' {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 21:17:30.762211 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.compute.api [None req-64e1c475-778c-41e1-988a-73e47855e0c5 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] [instance: 740370c6-f791-4204-a281-71d40f3ce49d] Fetching instance by UUID {{(pid=117860) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 21:17:30.769289 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-64e1c475-778c-41e1-988a-73e47855e0c5 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:30.769686 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-64e1c475-778c-41e1-988a-73e47855e0c5 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:30.770443 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-64e1c475-778c-41e1-988a-73e47855e0c5 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 21:17:30.770853 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG oslo_concurrency.lockutils [None req-64e1c475-778c-41e1-988a-73e47855e0c5 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Lock "8aa9ac8e-66e4-43b2-82e7-ace0654f5925" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117860) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 21:17:30.786031 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.wsgi [None req-64e1c475-778c-41e1-988a-73e47855e0c5 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] HTTP exception thrown: Instance 740370c6-f791-4204-a281-71d40f3ce49d could not be found. Jun 06 21:17:30.787708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-64e1c475-778c-41e1-988a-73e47855e0c5 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Request method failure captured: Jun 06 21:17:30.787708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: request: GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d HTTP/1.1 Jun 06 21:17:30.787708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept: application/json Jun 06 21:17:30.787708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Accept-Encoding: identity Jun 06 21:17:30.787708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Connection: close Jun 06 21:17:30.787708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Length: 0 Jun 06 21:17:30.787708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Content-Type: application/json Jun 06 21:17:30.787708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Host: 10.222.0.33 Jun 06 21:17:30.787708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Openstack-System-Scope: None Jun 06 21:17:30.787708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: User-Agent: python-urllib3/1.26.9 Jun 06 21:17:30.787708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Auth-Token: gAAAAABinm7aN2MzvdP6r5GUPOqi8lM3CAH4KWNJf2IKepaDQn0VnqvrWb4zJSPK4b__inb1wCPtBKjTywGPniToxQTVf0VDMYZ0tLNL2L_CHxIXfLPdw9fsCLPUOuYe4Uo11Kt6DKQqZtMMvg71eQ8bIa90skH-MtuzNxkmPR7eRAOhCPdi9GE Jun 06 21:17:30.787708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Id: None Jun 06 21:17:30.787708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Domain-Name: None Jun 06 21:17:30.787708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Identity-Status: Confirmed Jun 06 21:17:30.787708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Is-Admin-Project: True Jun 06 21:17:30.787708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Id: default Jun 06 21:17:30.787708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Domain-Name: Default Jun 06 21:17:30.787708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Id: f691f36fd59b408a8efb3b0a7f79d46f Jun 06 21:17:30.787708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Project-Name: tempest-VolumesNegativeTest-197471814 Jun 06 21:17:30.787708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Role: reader,member Jun 06 21:17:30.787708 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Roles: reader,member Jun 06 21:17:30.789530 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f691f36fd59b408a8efb3b0a7f79d46f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.33:8080", "publicURL": "http://10.222.0.33:8080/v1/AUTH_f691f36fd59b408a8efb3b0a7f79d46f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/compute/v2/f691f36fd59b408a8efb3b0a7f79d46f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33/volume/v3/f691f36fd59b408a8efb3b0a7f79d46f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.33:9696/"}]}] Jun 06 21:17:30.789530 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant: tempest-VolumesNegativeTest-197471814 Jun 06 21:17:30.789530 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Id: f691f36fd59b408a8efb3b0a7f79d46f Jun 06 21:17:30.789530 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-Tenant-Name: tempest-VolumesNegativeTest-197471814 Jun 06 21:17:30.789530 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User: tempest-VolumesNegativeTest-197471814-project Jun 06 21:17:30.789530 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Id: default Jun 06 21:17:30.789530 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Domain-Name: Default Jun 06 21:17:30.789530 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Id: 3e81b3131fbb4c248c30ab105d857a9a Jun 06 21:17:30.789530 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: X-User-Name: tempest-VolumesNegativeTest-197471814-project Jun 06 21:17:30.789530 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: method: > Jun 06 21:17:30.789530 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: exception: Instance 740370c6-f791-4204-a281-71d40f3ce49d could not be found. Jun 06 21:17:30.789530 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: action_args: {'id': '740370c6-f791-4204-a281-71d40f3ce49d'} Jun 06 21:17:30.790479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: {{(pid=117860) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 21:17:30.790479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:17:30.790479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 21:17:30.790479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 21:17:30.790479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 21:17:30.790479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 21:17:30.790479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 21:17:30.790479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 21:17:30.790479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 21:17:30.790479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 21:17:30.790479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 740370c6-f791-4204-a281-71d40f3ce49d could not be found. Jun 06 21:17:30.790479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:17:30.790479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:17:30.790479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:17:30.790479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:17:30.790479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:17:30.790479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:17:30.790479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 21:17:30.790479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 21:17:30.790479 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 21:17:30.792952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 21:17:30.792952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 21:17:30.792952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 21:17:30.792952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 21:17:30.792952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 21:17:30.792952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 21:17:30.792952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 21:17:30.792952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 740370c6-f791-4204-a281-71d40f3ce49d could not be found. Jun 06 21:17:30.792952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:17:30.792952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 21:17:30.792952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:17:30.792952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 21:17:30.792952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 21:17:30.792952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 21:17:30.792952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 21:17:30.792952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 21:17:30.792952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 740370c6-f791-4204-a281-71d40f3ce49d could not be found. Jun 06 21:17:30.792952 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: ERROR nova.api.openstack.wsgi Jun 06 21:17:30.794227 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: DEBUG nova.api.openstack.wsgi [None req-64e1c475-778c-41e1-988a-73e47855e0c5 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] Returning 404 to user: Instance 740370c6-f791-4204-a281-71d40f3ce49d could not be found. {{(pid=117860) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 21:17:30.794227 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO nova.api.openstack.requestlog [None req-64e1c475-778c-41e1-988a-73e47855e0c5 tempest-VolumesNegativeTest-197471814 tempest-VolumesNegativeTest-197471814-project] 10.222.0.33 "GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d" status: 404 len: 111 microversion: 2.1 time: 0.032670 Jun 06 21:17:30.794227 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: [pid: 117860|app: 0|req: 517/1072] 10.222.0.33 () {58 vars in 1235 bytes} [Mon Jun 6 21:17:30 2022] GET /compute/v2.1/servers/740370c6-f791-4204-a281-71d40f3ce49d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 21:18:24.406438 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 21:18:24.407174 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Mon Jun 6 21:18:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 21:18:32.523657 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 21:18:32.524461 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Mon Jun 6 21:18:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 21:19:39.232976 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 21:19:39.233656 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Mon Jun 6 21:19:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 21:20:01.854656 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 21:20:01.855487 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Mon Jun 6 21:20:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 21:20:15.553588 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 21:20:15.554661 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Mon Jun 6 21:20:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 21:21:31.678566 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 21:21:31.679357 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Mon Jun 6 21:21:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 21:21:44.417263 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 21:21:44.417853 dv-cinder-844880-1-iscsi devstack@n-api.service[117860]: Mon Jun 6 21:21:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 21:21:52.534303 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 21:21:52.535012 dv-cinder-844880-1-iscsi devstack@n-api.service[117859]: Mon Jun 6 21:21:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!